python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1988349 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Date 2026-09-13 08:50:29.646317 Current got : datou_id : 4189, datou_cur_ids : ['4388945'] with mtr_portfolio_ids : ['31138769'] and first list_photo_ids : [] new path : /proc/1988349/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.08310270309448242 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Sun Sep 13 08:50:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 257),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 224} 08092026 31138769 Nombre de photos uploadées : 257 / 23040 (1%) 08092026 31138769 Nombre de photos taguées (types de déchets): 224 / 257 (87%) 08092026 31138769 Nombre de photos taguées (volume) : 224 / 257 (87%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 0.00010347366333007812 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.01214289665222168 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6889736652374268 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.11251521110534668 Creating list_photo_total [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device Unable to find some descriptors in ovh, trying to find them in s3 Number missing : 224 Warning this was a bad idea s3 ! elapsed_time : select_descriptors 19.954586267471313 Missing descriptors : 224 08092026 31138769 Nombre de photos avec descriptors (type 5680) : 0 / 257 (0%) Missing descriptors for photos 0 and 1417563246 0:00:00|ON:Missing descriptors for photos 1417563246 and 1417563249 Missing descriptors for photos 1417563249 and 1417563252 Missing descriptors for photos 1417563252 and 1417563253 Missing descriptors for photos 1417563253 and 1417563257 Missing descriptors for photos 1417563257 and 1417563260 Missing descriptors for photos 1417563260 and 1417563637 Missing descriptors for photos 1417563637 and 1417563639 Missing descriptors for photos 1417563639 and 1417563640 Missing descriptors for photos 1417563640 and 1417563642 Missing descriptors for photos 1417563642 and 1417563643 Missing descriptors for photos 1417563643 and 1417563644 Missing descriptors for photos 1417563644 and 1417564059 Missing descriptors for photos 1417564059 and 1417564109 Missing descriptors for photos 1417564109 and 1417564161 Missing descriptors for photos 1417564161 and 1417564190 Missing descriptors for photos 1417564190 and 1417564193 Missing descriptors for photos 1417564193 and 1417564194 Missing descriptors for photos 1417564194 and 1417564658 LMissing descriptors for photos 1417564658 and 1417564689 LMissing descriptors for photos 1417564689 and 1417564727 LMissing descriptors for photos 1417564727 and 1417564748 LMissing descriptors for photos 1417564748 and 1417564752 LMissing descriptors for photos 1417564752 and 1417564754 LMissing descriptors for photos 1417564754 and 1417564841 LMissing descriptors for photos 1417564841 and 1417564844 LMissing descriptors for photos 1417564844 and 1417564847 LMissing descriptors for photos 1417564847 and 1417564849 LMissing descriptors for photos 1417564849 and 1417564850 LMissing descriptors for photos 1417564850 and 1417564852 LMissing descriptors for photos 1417564852 and 1417565792 LMissing descriptors for photos 1417565792 and 1417565796 LMissing descriptors for photos 1417565796 and 1417565798 LMissing descriptors for photos 1417565798 and 1417565801 LMissing descriptors for photos 1417565801 and 1417565803 LMissing descriptors for photos 1417565803 and 1417565804 LMissing descriptors for photos 1417565804 and 1417565906 LMissing descriptors for photos 1417565906 and 1417565908 LMissing descriptors for photos 1417565908 and 1417565911 LMissing descriptors for photos 1417565911 and 1417565931 Missing descriptors for photos 1417565931 and 1417565934 Missing descriptors for photos 1417565934 and 1417565935 Missing descriptors for photos 1417565935 and 1417565937 Missing descriptors for photos 1417565937 and 1417565940 Missing descriptors for photos 1417565940 and 1417565942 Missing descriptors for photos 1417565942 and 1417566030 Missing descriptors for photos 1417566030 and 1417566032 Missing descriptors for photos 1417566032 and 1417566035 Missing descriptors for photos 1417566035 and 1417566038 Missing descriptors for photos 1417566038 and 1417566040 Missing descriptors for photos 1417566040 and 1417566043 Missing descriptors for photos 1417566043 and 1417566222 Missing descriptors for photos 1417566222 and 1417566224 Missing descriptors for photos 1417566224 and 1417566226 Missing descriptors for photos 1417566226 and 1417566229 Missing descriptors for photos 1417566229 and 1417566233 Missing descriptors for photos 1417566233 and 1417566234 Missing descriptors for photos 1417566234 and 1417567021 Missing descriptors for photos 1417567021 and 1417567025 Missing descriptors for photos 1417567025 and 1417567026 Missing descriptors for photos 1417567026 and 1417567028 Missing descriptors for photos 1417567028 and 1417567030 Missing descriptors for photos 1417567030 and 1417567034 Missing descriptors for photos 1417567034 and 1417567745 Missing descriptors for photos 1417567745 and 1417567746 Missing descriptors for photos 1417567746 and 1417567748 Missing descriptors for photos 1417567748 and 1417567799 Missing descriptors for photos 1417567799 and 1417567857 Missing descriptors for photos 1417567857 and 1417567872 Missing descriptors for photos 1417567872 and 1417568049 Missing descriptors for photos 1417568049 and 1417568052 Missing descriptors for photos 1417568052 and 1417568054 Missing descriptors for photos 1417568054 and 1417568058 Missing descriptors for photos 1417568058 and 1417568060 Missing descriptors for photos 1417568060 and 1417568061 Missing descriptors for photos 1417568061 and 1417568250 LMissing descriptors for photos 1417568250 and 1417568255 LMissing descriptors for photos 1417568255 and 1417568259 LMissing descriptors for photos 1417568259 and 1417568261 LMissing descriptors for photos 1417568261 and 1417568262 LMissing descriptors for photos 1417568262 and 1417568264 LMissing descriptors for photos 1417568264 and 1417568744 Missing descriptors for photos 1417568744 and 1417568745 Missing descriptors for photos 1417568745 and 1417568746 Missing descriptors for photos 1417568746 and 1417568769 Missing descriptors for photos 1417568769 and 1417568772 Missing descriptors for photos 1417568772 and 1417568774 Missing descriptors for photos 1417568774 and 1417568776 Missing descriptors for photos 1417568776 and 1417568779 Missing descriptors for photos 1417568779 and 1417568782 Missing descriptors for photos 1417568782 and 1417568973 Missing descriptors for photos 1417568973 and 1417568975 Missing descriptors for photos 1417568975 and 1417568978 Missing descriptors for photos 1417568978 and 1417568981 Missing descriptors for photos 1417568981 and 1417568983 Missing descriptors for photos 1417568983 and 1417568984 Missing descriptors for photos 1417568984 and 1417570328 Missing descriptors for photos 1417570328 and 1417570404 Missing descriptors for photos 1417570404 and 1417570463 Missing descriptors for photos 1417570463 and 1417570502 Missing descriptors for photos 1417570502 and 1417570504 Missing descriptors for photos 1417570504 and 1417570525 Missing descriptors for photos 1417570525 and 1417570879 Missing descriptors for photos 1417570879 and 1417570883 Missing descriptors for photos 1417570883 and 1417570886 Missing descriptors for photos 1417570886 and 1417570925 Missing descriptors for photos 1417570925 and 1417570992 Missing descriptors for photos 1417570992 and 1417571041 Missing descriptors for photos 1417571041 and 1417571208 LMissing descriptors for photos 1417571208 and 1417571209 LMissing descriptors for photos 1417571209 and 1417571211 LMissing descriptors for photos 1417571211 and 1417571214 LMissing descriptors for photos 1417571214 and 1417571217 LMissing descriptors for photos 1417571217 and 1417571219 LMissing descriptors for photos 1417571219 and 1417571359 Missing descriptors for photos 1417571359 and 1417571360 Missing descriptors for photos 1417571360 and 1417571361 Missing descriptors for photos 1417571361 and 1417571364 Missing descriptors for photos 1417571364 and 1417571383 Missing descriptors for photos 1417571383 and 1417571384 Missing descriptors for photos 1417571384 and 1417571387 Missing descriptors for photos 1417571387 and 1417571390 Missing descriptors for photos 1417571390 and 1417571394 Missing descriptors for photos 1417571394 and 1417571396 Missing descriptors for photos 1417571396 and 1417571495 Missing descriptors for photos 1417571495 and 1417571501 Missing descriptors for photos 1417571501 and 1417571502 Missing descriptors for photos 1417571502 and 1417571505 Missing descriptors for photos 1417571505 and 1417571514 Missing descriptors for photos 1417571514 and 1417571520 Missing descriptors for photos 1417571520 and 1417571613 Missing descriptors for photos 1417571613 and 1417571614 Missing descriptors for photos 1417571614 and 1417571616 Missing descriptors for photos 1417571616 and 1417571619 Missing descriptors for photos 1417571619 and 1417571622 Missing descriptors for photos 1417571622 and 1417571624 Missing descriptors for photos 1417571624 and 1417571954 Missing descriptors for photos 1417571954 and 1417571957 Missing descriptors for photos 1417571957 and 1417571959 Missing descriptors for photos 1417571959 and 1417571961 Missing descriptors for photos 1417571961 and 1417571963 Missing descriptors for photos 1417571963 and 1417571972 Missing descriptors for photos 1417571972 and 1417573619 Missing descriptors for photos 1417573619 and 1417573623 Missing descriptors for photos 1417573623 and 1417573628 Missing descriptors for photos 1417573628 and 1417573630 Missing descriptors for photos 1417573630 and 1417573631 Missing descriptors for photos 1417573631 and 1417573633 Missing descriptors for photos 1417573633 and 1417573942 Missing descriptors for photos 1417573942 and 1417573945 Missing descriptors for photos 1417573945 and 1417573946 Missing descriptors for photos 1417573946 and 1417573947 Missing descriptors for photos 1417573947 and 1417573950 Missing descriptors for photos 1417573950 and 1417573951 Missing descriptors for photos 1417573951 and 1417574034 Missing descriptors for photos 1417574034 and 1417574035 Missing descriptors for photos 1417574035 and 1417574036 Missing descriptors for photos 1417574036 and 1417574039 Missing descriptors for photos 1417574039 and 1417574045 Missing descriptors for photos 1417574045 and 1417574051 Missing descriptors for photos 1417574051 and 1417574440 Missing descriptors for photos 1417574440 and 1417574442 Missing descriptors for photos 1417574442 and 1417574444 Missing descriptors for photos 1417574444 and 1417574686 Missing descriptors for photos 1417574686 and 1417574688 Missing descriptors for photos 1417574688 and 1417574690 Missing descriptors for photos 1417574690 and 1417574693 Missing descriptors for photos 1417574693 and 1417574695 Missing descriptors for photos 1417574695 and 1417574698 Missing descriptors for photos 1417574698 and 1417574789 Missing descriptors for photos 1417574789 and 1417574790 Missing descriptors for photos 1417574790 and 1417574792 Missing descriptors for photos 1417574792 and 1417574794 Missing descriptors for photos 1417574794 and 1417574797 Missing descriptors for photos 1417574797 and 1417574799 Missing descriptors for photos 1417574799 and 1417575029 Missing descriptors for photos 1417575029 and 1417575032 Missing descriptors for photos 1417575032 and 1417575034 Missing descriptors for photos 1417575034 and 1417575037 Missing descriptors for photos 1417575037 and 1417575039 Missing descriptors for photos 1417575039 and 1417575040 Missing descriptors for photos 1417575040 and 1417575129 Missing descriptors for photos 1417575129 and 1417575131 Missing descriptors for photos 1417575131 and 1417575134 Missing descriptors for photos 1417575134 and 1417575138 Missing descriptors for photos 1417575138 and 1417575139 Missing descriptors for photos 1417575139 and 1417575141 Missing descriptors for photos 1417575141 and 1417575602 Missing descriptors for photos 1417575602 and 1417575603 Missing descriptors for photos 1417575603 and 1417575605 Missing descriptors for photos 1417575605 and 1417575608 Missing descriptors for photos 1417575608 and 1417575611 Missing descriptors for photos 1417575611 and 1417575613 Missing descriptors for photos 1417575613 and 1417576260 Missing descriptors for photos 1417576260 and 1417576263 Missing descriptors for photos 1417576263 and 1417576265 Missing descriptors for photos 1417576265 and 1417576268 Missing descriptors for photos 1417576268 and 1417576269 Missing descriptors for photos 1417576269 and 1417576271 Missing descriptors for photos 1417576271 and 1417577727 Missing descriptors for photos 1417577727 and 1417577728 Missing descriptors for photos 1417577728 and 1417577730 Missing descriptors for photos 1417577730 and 1417577751 Missing descriptors for photos 1417577751 and 1417577752 Missing descriptors for photos 1417577752 and 1417577754 Missing descriptors for photos 1417577754 and 1417577758 Missing descriptors for photos 1417577758 and 1417577765 Missing descriptors for photos 1417577765 and 1417577768 Missing descriptors for photos 1417577768 and 1417578303 Missing descriptors for photos 1417578303 and 1417578307 Missing descriptors for photos 1417578307 and 1417578310 Missing descriptors for photos 1417578310 and 1417578312 Missing descriptors for photos 1417578312 and 1417578313 Missing descriptors for photos 1417578313 and 1417578314 Missing descriptors for photos 1417578314 and 1417578401 Missing descriptors for photos 1417578401 and 1417578403 Missing descriptors for photos 1417578403 and 1417578405 Missing descriptors for photos 1417578405 and 1417578410 Missing descriptors for photos 1417578410 and 1417578411 Missing descriptors for photos 1417578411 and 1417578412 Missing descriptors for photos 1417578412 and 1417578533 Missing descriptors for photos 1417578533 and 1417578535 Missing descriptors for photos 1417578535 and 1417578536 Missing descriptors for photos 1417578536 and 1417578539 Missing descriptors for photos 1417578539 and 1417578541 Missing descriptors for photos 1417578541 and 1417578544 Missing descriptors for photos 1417578544 and 1417578913 Missing descriptors for photos 1417578913 and 1417578924 Missing descriptors for photos 1417578924 and 1417578927 Missing descriptors for photos 1417578927 and 1417578931 Missing descriptors for photos 1417578931 and 1417578933 Missing descriptors for photos 1417578933 and 1417578936 Missing descriptors for photos 1417578936 and 1417579642 Missing descriptors for photos 1417579642 and 1417579645 Missing descriptors for photos 1417579645 and 1417579647 Missing descriptors for photos 1417579647 and 1417579648 Missing descriptors for photos 1417579648 and 1417579650 Missing descriptors for photos 1417579650 and 1417579653 Missing descriptors for photos 1417579653 and 1417581254 LMissing descriptors for photos 1417581254 and 1417581257 LMissing descriptors for photos 1417581257 and 1417581279 LMissing descriptors for photos 1417581279 and 1417581282 LMissing descriptors for photos 1417581282 and 1417581260 LMissing descriptors for photos 1417581260 and 1417581284 LMissing descriptors for photos 1417581284 and 1417581285 LMissing descriptors for photos 1417581285 and 1417581288 LMissing descriptors for photos 1417581288 and 1417581291 LMissing descriptors for photos 1417581291 and 1417581475 LMissing descriptors for photos 1417581475 and 1417581476 LMissing descriptors for photos 1417581476 and 1417581479 LMissing descriptors for photos 1417581479 and 1417581482 LMissing descriptors for photos 1417581482 and 1417581485 LMissing descriptors for photos 1417581485 and 1417581487 LMissing descriptors for photos 1417581487 and 1417581997 LMissing descriptors for photos 1417581997 and 1417581999 LMissing descriptors for photos 1417581999 and 1417582020 LMissing descriptors for photos 1417582020 and 1417582038 L 08092026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 257 time used for this insertion : 0.17963671684265137 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.2743678092956543 To do, maybe not at the correct place ! ...................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.....................................L.L.L.L.L.L............................L.L.L.L.L.L.............................................................................................................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.025014400482177734 NUMBER BATCH : 3 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_JRM:{'day': '08092026', 'map_nb_amount': {0: 14, 1: 23, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.7354409694672, 'nb_balles_papier': 0.0006700000000000011, 'begin_time_port': 'image_08092026_10_00_02_466651m0.jpg 1e-05 for time 1, id_amount 1 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0006700000000000011 LLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_JRM:{'day': '08092026', 'map_nb_amount': {0: 26, 1: 21, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.9906370639801, 'nb_balles_papier': 0.0007900000000000014, 'begin_time_port': 'image_08092026_10_15_03_153365m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0007900000000000014 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '08092026', 'map_nb_amount': {0: 19, 1: 34, 2: 8, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 719.9666469097137, 'nb_balles_papier': 0.0007800000000000014, 'begin_time_port': 'image_08092026_10_30_03_008938m0.jpg 1e-05 for time 1, id_amount 1 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0007800000000000014 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 3 list_same_port_ids : [31139458] find same portfolio which already exist 31139458 , we will use it list_same_port_ids : [31139940] find same portfolio which already exist 31139940 , we will use it list_same_port_ids : [] Qualite : 0.1719215794786214 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31139458 AND mptpi.`type`=3726 To do Qualite : 0.1613285474774132 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31139940 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31162434 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 4.696152687072754 # DISPLAY ALL COLLECTED DATA : {'08092026': {'nb_upload': 257, 'nb_taggue_class': 224, 'nb_taggue_densite': 224, 'nb_descriptors': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1417582038, 1417582020, 1417581999, 1417581997, 1417581487, 1417581485, 1417581482, 1417581479, 1417581476, 1417581475, 1417581291, 1417581288, 1417581285, 1417581284, 1417581282, 1417581279, 1417581260, 1417581257, 1417581254, 1417579653, 1417579650, 1417579648, 1417579647, 1417579645, 1417579642, 1417578936, 1417578933, 1417578931, 1417578927, 1417578924, 1417578913, 1417578544, 1417578541, 1417578539, 1417578536, 1417578535, 1417578533, 1417578412, 1417578411, 1417578410, 1417578405, 1417578403, 1417578401, 1417578314, 1417578313, 1417578312, 1417578310, 1417578307, 1417578303, 1417577768, 1417577765, 1417577758, 1417577754, 1417577752, 1417577751, 1417577730, 1417577728, 1417577727, 1417576271, 1417576269, 1417576268, 1417576265, 1417576263, 1417576260, 1417575613, 1417575611, 1417575608, 1417575605, 1417575603, 1417575602, 1417575141, 1417575139, 1417575138, 1417575134, 1417575131, 1417575129, 1417575040, 1417575039, 1417575037, 1417575034, 1417575032, 1417575029, 1417574799, 1417574797, 1417574794, 1417574792, 1417574790, 1417574789, 1417574698, 1417574695, 1417574693, 1417574690, 1417574688, 1417574686, 1417574444, 1417574442, 1417574440, 1417574051, 1417574045, 1417574039] Looping around the photos to save general results len do output : 1 /31138769Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417582038', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417582020', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581999', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581997', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581487', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581485', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581482', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581479', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581476', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581475', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581291', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581288', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581285', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581284', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581282', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581279', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581260', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581257', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417581254', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417579653', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417579650', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417579648', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417579647', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417579645', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417579642', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578936', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578933', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578931', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578927', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578924', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578913', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578544', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578541', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578539', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578536', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578535', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578533', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578412', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578411', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578410', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578405', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578403', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578401', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578314', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578313', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578312', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578310', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578307', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417578303', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577768', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577765', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577758', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577754', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577752', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577751', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577730', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577728', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417577727', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417576271', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417576269', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417576268', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417576265', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417576263', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417576260', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575613', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575611', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575608', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575605', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575603', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575602', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575141', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575139', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575138', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575134', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575131', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575129', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575040', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575039', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575037', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575034', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575032', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417575029', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574799', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574797', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574794', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574792', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574790', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574789', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574698', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574695', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574693', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574690', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574688', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574686', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574444', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574442', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574440', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574051', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574045', None, None, None, None, None, '4388945') ('4189', None, None, None, None, None, None, None, '4388945') ('4189', '31138769', '1417574039', None, None, None, None, None, '4388945') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.05265498161315918 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.052366256713867 time spend to save output : 0.05342745780944824 total time spend for step 1 : 26.105793714523315 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.89user 0.83system 0:29.50elapsed 9%CPU (0avgtext+0avgdata 118480maxresident)k 496inputs+144outputs (5major+58881minor)pagefaults 0swaps