python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1986589 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Date 2026-09-13 08:45:28.960389 Current got : datou_id : 4189, datou_cur_ids : ['4388944'] with mtr_portfolio_ids : ['31144149'] and first list_photo_ids : [] new path : /proc/1986589/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.08470273017883301 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Sun Sep 13 08:45:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 241),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 231} L09092026 31144149 Nombre de photos uploadées : 241 / 23040 (1%) 09092026 31144149 Nombre de photos taguées (types de déchets): 231 / 241 (95%) 09092026 31144149 Nombre de photos taguées (volume) : 231 / 241 (95%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 6.413459777832031e-05 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0074770450592041016 LCatched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6754274368286133 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.09221720695495605 Creating list_photo_total [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device Unable to find some descriptors in ovh, trying to find them in s3 Number missing : 231 Warning this was a bad idea s3 ! elapsed_time : select_descriptors 20.581984758377075 Missing descriptors : 231 09092026 31144149 Nombre de photos avec descriptors (type 5680) : 0 / 241 (0%) Missing descriptors for photos 0 and 1417628094 L0:00:00|ON:Missing descriptors for photos 1417628094 and 1417628097 LMissing descriptors for photos 1417628097 and 1417628100 LMissing descriptors for photos 1417628100 and 1417628102 LMissing descriptors for photos 1417628102 and 1417628103 LMissing descriptors for photos 1417628103 and 1417628104 LMissing descriptors for photos 1417628104 and 1417628328 Missing descriptors for photos 1417628328 and 1417628425 Missing descriptors for photos 1417628425 and 1417628451 Missing descriptors for photos 1417628451 and 1417628453 Missing descriptors for photos 1417628453 and 1417628480 Missing descriptors for photos 1417628480 and 1417628521 Missing descriptors for photos 1417628521 and 1417628662 Missing descriptors for photos 1417628662 and 1417628716 Missing descriptors for photos 1417628716 and 1417628771 Missing descriptors for photos 1417628771 and 1417628827 Missing descriptors for photos 1417628827 and 1417628879 Missing descriptors for photos 1417628879 and 1417628938 Missing descriptors for photos 1417628938 and 1417631104 Missing descriptors for photos 1417631104 and 1417631108 Missing descriptors for photos 1417631108 and 1417631110 Missing descriptors for photos 1417631110 and 1417631113 Missing descriptors for photos 1417631113 and 1417631115 Missing descriptors for photos 1417631115 and 1417631116 Missing descriptors for photos 1417631116 and 1417631192 Missing descriptors for photos 1417631192 and 1417631195 Missing descriptors for photos 1417631195 and 1417631197 Missing descriptors for photos 1417631197 and 1417631199 Missing descriptors for photos 1417631199 and 1417631200 Missing descriptors for photos 1417631200 and 1417631201 Missing descriptors for photos 1417631201 and 1417631341 Missing descriptors for photos 1417631341 and 1417631342 Missing descriptors for photos 1417631342 and 1417631343 Missing descriptors for photos 1417631343 and 1417631345 Missing descriptors for photos 1417631345 and 1417631348 Missing descriptors for photos 1417631348 and 1417631350 Missing descriptors for photos 1417631350 and 1417631718 Missing descriptors for photos 1417631718 and 1417631719 Missing descriptors for photos 1417631719 and 1417631722 Missing descriptors for photos 1417631722 and 1417631724 Missing descriptors for photos 1417631724 and 1417631727 Missing descriptors for photos 1417631727 and 1417631728 Missing descriptors for photos 1417631728 and 1417632129 Missing descriptors for photos 1417632129 and 1417632132 Missing descriptors for photos 1417632132 and 1417632135 Missing descriptors for photos 1417632135 and 1417632137 Missing descriptors for photos 1417632137 and 1417632138 Missing descriptors for photos 1417632138 and 1417632140 Missing descriptors for photos 1417632140 and 1417633156 Missing descriptors for photos 1417633156 and 1417633158 Missing descriptors for photos 1417633158 and 1417633160 Missing descriptors for photos 1417633160 and 1417633161 Missing descriptors for photos 1417633161 and 1417633163 Missing descriptors for photos 1417633163 and 1417633164 Missing descriptors for photos 1417633164 and 1417634241 Missing descriptors for photos 1417634241 and 1417634299 Missing descriptors for photos 1417634299 and 1417634356 Missing descriptors for photos 1417634356 and 1417634413 Missing descriptors for photos 1417634413 and 1417634468 Missing descriptors for photos 1417634468 and 1417634520 Missing descriptors for photos 1417634520 and 1417635531 Missing descriptors for photos 1417635531 and 1417635532 Missing descriptors for photos 1417635532 and 1417635533 Missing descriptors for photos 1417635533 and 1417635535 Missing descriptors for photos 1417635535 and 1417635538 Missing descriptors for photos 1417635538 and 1417635539 Missing descriptors for photos 1417635539 and 1417635770 LMissing descriptors for photos 1417635770 and 1417635773 LMissing descriptors for photos 1417635773 and 1417635776 LMissing descriptors for photos 1417635776 and 1417635779 LMissing descriptors for photos 1417635779 and 1417635797 Missing descriptors for photos 1417635797 and 1417635800 Missing descriptors for photos 1417635800 and 1417635802 Missing descriptors for photos 1417635802 and 1417635804 Missing descriptors for photos 1417635804 and 1417635806 Missing descriptors for photos 1417635806 and 1417635808 Missing descriptors for photos 1417635808 and 1417635981 Missing descriptors for photos 1417635981 and 1417635985 Missing descriptors for photos 1417635985 and 1417635988 Missing descriptors for photos 1417635988 and 1417635990 Missing descriptors for photos 1417635990 and 1417635991 Missing descriptors for photos 1417635991 and 1417635993 Missing descriptors for photos 1417635993 and 1417637421 Missing descriptors for photos 1417637421 and 1417637423 Missing descriptors for photos 1417637423 and 1417637424 Missing descriptors for photos 1417637424 and 1417637426 Missing descriptors for photos 1417637426 and 1417637429 Missing descriptors for photos 1417637429 and 1417637432 Missing descriptors for photos 1417637432 and 1417637758 Missing descriptors for photos 1417637758 and 1417637761 Missing descriptors for photos 1417637761 and 1417637762 Missing descriptors for photos 1417637762 and 1417637764 Missing descriptors for photos 1417637764 and 1417637767 Missing descriptors for photos 1417637767 and 1417637769 Missing descriptors for photos 1417637769 and 1417638590 Missing descriptors for photos 1417638590 and 1417638592 Missing descriptors for photos 1417638592 and 1417638594 Missing descriptors for photos 1417638594 and 1417638596 Missing descriptors for photos 1417638596 and 1417638597 Missing descriptors for photos 1417638597 and 1417638598 Missing descriptors for photos 1417638598 and 1417638680 Missing descriptors for photos 1417638680 and 1417638683 Missing descriptors for photos 1417638683 and 1417638687 Missing descriptors for photos 1417638687 and 1417638689 Missing descriptors for photos 1417638689 and 1417638690 Missing descriptors for photos 1417638690 and 1417638691 Missing descriptors for photos 1417638691 and 1417638812 Missing descriptors for photos 1417638812 and 1417638813 Missing descriptors for photos 1417638813 and 1417638814 Missing descriptors for photos 1417638814 and 1417638816 Missing descriptors for photos 1417638816 and 1417638834 Missing descriptors for photos 1417638834 and 1417638836 Missing descriptors for photos 1417638836 and 1417638839 Missing descriptors for photos 1417638839 and 1417638840 Missing descriptors for photos 1417638840 and 1417638842 Missing descriptors for photos 1417638842 and 1417638845 Missing descriptors for photos 1417638845 and 1417639093 Missing descriptors for photos 1417639093 and 1417639096 Missing descriptors for photos 1417639096 and 1417639099 Missing descriptors for photos 1417639099 and 1417639102 Missing descriptors for photos 1417639102 and 1417639104 Missing descriptors for photos 1417639104 and 1417639105 Missing descriptors for photos 1417639105 and 1417639191 Missing descriptors for photos 1417639191 and 1417639192 Missing descriptors for photos 1417639192 and 1417639194 Missing descriptors for photos 1417639194 and 1417639196 Missing descriptors for photos 1417639196 and 1417639199 Missing descriptors for photos 1417639199 and 1417639202 Missing descriptors for photos 1417639202 and 1417639975 Missing descriptors for photos 1417639975 and 1417639979 Missing descriptors for photos 1417639979 and 1417639991 Missing descriptors for photos 1417639991 and 1417639992 Missing descriptors for photos 1417639992 and 1417639993 Missing descriptors for photos 1417639993 and 1417639995 Missing descriptors for photos 1417639995 and 1417640396 Missing descriptors for photos 1417640396 and 1417640399 Missing descriptors for photos 1417640399 and 1417640403 Missing descriptors for photos 1417640403 and 1417640405 Missing descriptors for photos 1417640405 and 1417640406 Missing descriptors for photos 1417640406 and 1417640407 Missing descriptors for photos 1417640407 and 1417641590 Missing descriptors for photos 1417641590 and 1417641592 Missing descriptors for photos 1417641592 and 1417641594 Missing descriptors for photos 1417641594 and 1417641598 Missing descriptors for photos 1417641598 and 1417641601 Missing descriptors for photos 1417641601 and 1417641602 Missing descriptors for photos 1417641602 and 1417642651 Missing descriptors for photos 1417642651 and 1417642653 Missing descriptors for photos 1417642653 and 1417642654 Missing descriptors for photos 1417642654 and 1417642656 Missing descriptors for photos 1417642656 and 1417642660 Missing descriptors for photos 1417642660 and 1417642664 Missing descriptors for photos 1417642664 and 1417642733 Missing descriptors for photos 1417642733 and 1417642737 Missing descriptors for photos 1417642737 and 1417642739 Missing descriptors for photos 1417642739 and 1417642743 Missing descriptors for photos 1417642743 and 1417642744 Missing descriptors for photos 1417642744 and 1417642745 Missing descriptors for photos 1417642745 and 1417643169 Missing descriptors for photos 1417643169 and 1417643171 Missing descriptors for photos 1417643171 and 1417643174 Missing descriptors for photos 1417643174 and 1417643179 Missing descriptors for photos 1417643179 and 1417643180 Missing descriptors for photos 1417643180 and 1417643183 Missing descriptors for photos 1417643183 and 1417643533 Missing descriptors for photos 1417643533 and 1417643537 Missing descriptors for photos 1417643537 and 1417643540 Missing descriptors for photos 1417643540 and 1417643543 Missing descriptors for photos 1417643543 and 1417643544 Missing descriptors for photos 1417643544 and 1417643545 Missing descriptors for photos 1417643545 and 1417643619 Missing descriptors for photos 1417643619 and 1417643620 Missing descriptors for photos 1417643620 and 1417643668 Missing descriptors for photos 1417643668 and 1417643716 Missing descriptors for photos 1417643716 and 1417643759 Missing descriptors for photos 1417643759 and 1417643804 Missing descriptors for photos 1417643804 and 1417645345 LMissing descriptors for photos 1417645345 and 1417645348 LMissing descriptors for photos 1417645348 and 1417645351 LMissing descriptors for photos 1417645351 and 1417645368 LMissing descriptors for photos 1417645368 and 1417645369 LMissing descriptors for photos 1417645369 and 1417645372 LMissing descriptors for photos 1417645372 and 1417645375 LMissing descriptors for photos 1417645375 and 1417645378 LMissing descriptors for photos 1417645378 and 1417645380 LMissing descriptors for photos 1417645380 and 1417645495 LMissing descriptors for photos 1417645495 and 1417645498 LMissing descriptors for photos 1417645498 and 1417645499 LMissing descriptors for photos 1417645499 and 1417645502 LMissing descriptors for photos 1417645502 and 1417645505 LMissing descriptors for photos 1417645505 and 1417645507 LMissing descriptors for photos 1417645507 and 1417645969 LMissing descriptors for photos 1417645969 and 1417645970 LMissing descriptors for photos 1417645970 and 1417645971 LMissing descriptors for photos 1417645971 and 1417645973 LMissing descriptors for photos 1417645973 and 1417645976 LMissing descriptors for photos 1417645976 and 1417645979 LMissing descriptors for photos 1417645979 and 1417646061 LMissing descriptors for photos 1417646061 and 1417646064 LMissing descriptors for photos 1417646064 and 1417646067 LMissing descriptors for photos 1417646067 and 1417646070 LMissing descriptors for photos 1417646070 and 1417646073 LMissing descriptors for photos 1417646073 and 1417646074 LMissing descriptors for photos 1417646074 and 1417646324 LMissing descriptors for photos 1417646324 and 1417646376 LMissing descriptors for photos 1417646376 and 1417646429 LMissing descriptors for photos 1417646429 and 1417646484 LMissing descriptors for photos 1417646484 and 1417646539 LMissing descriptors for photos 1417646539 and 1417646588 LMissing descriptors for photos 1417646588 and 1417646985 LMissing descriptors for photos 1417646985 and 1417646989 LMissing descriptors for photos 1417646989 and 1417646991 LMissing descriptors for photos 1417646991 and 1417646992 LMissing descriptors for photos 1417646992 and 1417646994 LMissing descriptors for photos 1417646994 and 1417646996 LMissing descriptors for photos 1417646996 and 1417647646 LMissing descriptors for photos 1417647646 and 1417647649 LMissing descriptors for photos 1417647649 and 1417647651 LMissing descriptors for photos 1417647651 and 1417647654 LMissing descriptors for photos 1417647654 and 1417647656 LMissing descriptors for photos 1417647656 and 1417647657 LMissing descriptors for photos 1417647657 and 1417648269 LMissing descriptors for photos 1417648269 and 1417648322 LMissing descriptors for photos 1417648322 and 1417648373 LMissing descriptors for photos 1417648373 and 1417648403 LMissing descriptors for photos 1417648403 and 1417648437 LMissing descriptors for photos 1417648437 and 1417648499 LMissing descriptors for photos 1417648499 and 1417648704 LMissing descriptors for photos 1417648704 and 1417648707 LMissing descriptors for photos 1417648707 and 1417648727 LMissing descriptors for photos 1417648727 and 1417648728 LMissing descriptors for photos 1417648728 and 1417648744 LMissing descriptors for photos 1417648744 and 1417648794 LMissing descriptors for photos 1417648794 and 1417648823 LMissing descriptors for photos 1417648823 and 1417648846 LMissing descriptors for photos 1417648846 and 1417648966 LMissing descriptors for photos 1417648966 and 1417648967 LMissing descriptors for photos 1417648967 and 1417648968 LMissing descriptors for photos 1417648968 and 1417648971 LMissing descriptors for photos 1417648971 and 1417648973 LMissing descriptors for photos 1417648973 and 1417648978 L 09092026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 241 time used for this insertion : 0.1288738250732422 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.2247302532196045 To do, maybe not at the correct place ! .L.L.L.L.L.L.............................................................L.L.L.L...........................................................................................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.024195194244384766 NUMBER BATCH : 3 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info Lresult_one_balle_Type_JRM:{'day': '09092026', 'map_nb_amount': {0: 9, 1: 23, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 842.2914600372314, 'nb_balles_papier': 0.0008200000000000015, 'begin_time_port': 'image_09092026_10_00_02_331866_0000.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0008200000000000015 LLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '09092026', 'map_nb_amount': {0: 8, 1: 30, 2: 0, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.9860830307007, 'nb_balles_papier': 0.0009700000000000019, 'begin_time_port': 'image_09092026_10_15_02_436173m0.jpg 1e-05 for time 1, id_amount 0 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0009700000000000019 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '09092026', 'map_nb_amount': {0: 8, 1: 18, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 480.73062205314636, 'nb_balles_papier': 0.0005200000000000007, 'begin_time_port': 'image_09092026_10_30_02_320684_0000.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0005200000000000007 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 3 list_same_port_ids : [31145128] find same portfolio which already exist 31145128 , we will use it list_same_port_ids : [] list_same_port_ids : [] Qualite : 0.22519204161512388 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31145128 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31162431 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31162432 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 8.220137596130371 # DISPLAY ALL COLLECTED DATA : {'09092026': {'nb_upload': 241, 'nb_taggue_class': 231, 'nb_taggue_densite': 231, 'nb_descriptors': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1417648978, 1417648973, 1417648971, 1417648968, 1417648967, 1417648966, 1417648846, 1417648823, 1417648794, 1417648744, 1417648728, 1417648727, 1417648707, 1417648704, 1417648499, 1417648437, 1417648403, 1417648373, 1417648322, 1417648269, 1417647657, 1417647656, 1417647654, 1417647651, 1417647649, 1417647646, 1417646996, 1417646994, 1417646992, 1417646991, 1417646989, 1417646985, 1417646588, 1417646539, 1417646484, 1417646429, 1417646376, 1417646324, 1417646074, 1417646073, 1417646070, 1417646067, 1417646064, 1417646061, 1417645979, 1417645976, 1417645973, 1417645971, 1417645970, 1417645969, 1417645507, 1417645505, 1417645502, 1417645499, 1417645498, 1417645495, 1417645380, 1417645378, 1417645375, 1417645372, 1417645369, 1417645368, 1417645351, 1417645348, 1417645345, 1417643804, 1417643759, 1417643716, 1417643668, 1417643620, 1417643619, 1417643545, 1417643544, 1417643543, 1417643540, 1417643537, 1417643533, 1417643183, 1417643180, 1417643179, 1417643174, 1417643171, 1417643169, 1417642745, 1417642744, 1417642743, 1417642739, 1417642737, 1417642733, 1417642664, 1417642660, 1417642656, 1417642654, 1417642653, 1417642651, 1417641602, 1417641601, 1417641598, 1417641594, 1417641592] Looping around the photos to save general results len do output : 1 /31144149Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648978', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648973', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648971', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648968', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648967', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648966', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648846', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648823', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648794', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648744', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648728', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648727', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648707', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648704', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648499', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648437', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648403', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648373', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648322', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417648269', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417647657', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417647656', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417647654', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417647651', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417647649', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417647646', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646996', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646994', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646992', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646991', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646989', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646985', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646588', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646539', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646484', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646429', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646376', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646324', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646074', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646073', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646070', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646067', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646064', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417646061', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645979', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645976', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645973', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645971', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645970', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645969', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645507', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645505', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645502', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645499', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645498', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645495', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645380', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645378', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645375', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645372', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645369', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645368', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645351', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645348', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417645345', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643804', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643759', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643716', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643668', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643620', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643619', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643545', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643544', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643543', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643540', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643537', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643533', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643183', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643180', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643179', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643174', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643171', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417643169', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642745', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642744', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642743', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642739', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642737', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642733', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642664', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642660', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642656', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642654', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642653', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417642651', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417641602', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417641601', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417641598', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417641594', None, None, None, None, None, '4388944') ('4189', None, None, None, None, None, None, None, '4388944') ('4189', '31144149', '1417641592', None, None, None, None, None, '4388944') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.05971217155456543 save_final save missing photos in datou_result : time spend for datou_step_exec : 30.10428738594055 time spend to save output : 0.0604860782623291 total time spend for step 1 : 30.16477346420288 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.74user 0.86system 0:34.37elapsed 7%CPU (0avgtext+0avgdata 118756maxresident)k 272inputs+152outputs (15major+58784minor)pagefaults 0swaps