python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3362120 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Date 2026-09-14 15:30:30.937872 Current got : datou_id : 4189, datou_cur_ids : ['4389432'] with mtr_portfolio_ids : ['31166259'] and first list_photo_ids : [] new path : /proc/3362120/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.07004642486572266 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Mon Sep 14 15:30:31 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 201),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} L14092026 31166259 Nombre de photos uploadées : 201 / 23040 (0%) 14092026 31166259 Nombre de photos taguées (types de déchets): 0 / 201 (0%) 14092026 31166259 Nombre de photos taguées (volume) : 0 / 201 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.00976872444152832 LCatched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.715134859085083 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.005959987640380859 Creating list_photo_total elapsed_time : select_descriptors 0.03383970260620117 14092026 31166259 Nombre de photos avec descriptors (type 5680) : 0 / 201 (0%) Missing descriptors for photos 0 and 1417907779 L0:00:00|ON:Missing descriptors for photos 1417907779 and 1417907780 LMissing descriptors for photos 1417907780 and 1417907781 LMissing descriptors for photos 1417907781 and 1417907782 LMissing descriptors for photos 1417907782 and 1417907783 LMissing descriptors for photos 1417907783 and 1417907784 LMissing descriptors for photos 1417907784 and 1417907812 LMissing descriptors for photos 1417907812 and 1417907813 LMissing descriptors for photos 1417907813 and 1417907814 LMissing descriptors for photos 1417907814 and 1417907815 LMissing descriptors for photos 1417907815 and 1417907816 LMissing descriptors for photos 1417907816 and 1417907817 LMissing descriptors for photos 1417907817 and 1417907850 LMissing descriptors for photos 1417907850 and 1417907851 LMissing descriptors for photos 1417907851 and 1417907852 LMissing descriptors for photos 1417907852 and 1417907853 LMissing descriptors for photos 1417907853 and 1417907855 LMissing descriptors for photos 1417907855 and 1417907856 LMissing descriptors for photos 1417907856 and 1417907885 LMissing descriptors for photos 1417907885 and 1417907886 LMissing descriptors for photos 1417907886 and 1417907887 LMissing descriptors for photos 1417907887 and 1417907888 LMissing descriptors for photos 1417907888 and 1417907889 LMissing descriptors for photos 1417907889 and 1417907890 LMissing descriptors for photos 1417907890 and 1417907908 LMissing descriptors for photos 1417907908 and 1417907909 LMissing descriptors for photos 1417907909 and 1417907910 LMissing descriptors for photos 1417907910 and 1417907911 LMissing descriptors for photos 1417907911 and 1417907913 LMissing descriptors for photos 1417907913 and 1417907914 LMissing descriptors for photos 1417907914 and 1417907915 LMissing descriptors for photos 1417907915 and 1417907916 LMissing descriptors for photos 1417907916 and 1417907918 LMissing descriptors for photos 1417907918 and 1417907920 LMissing descriptors for photos 1417907920 and 1417907947 LMissing descriptors for photos 1417907947 and 1417907948 LMissing descriptors for photos 1417907948 and 1417907949 LMissing descriptors for photos 1417907949 and 1417907950 LMissing descriptors for photos 1417907950 and 1417907951 LMissing descriptors for photos 1417907951 and 1417907952 LMissing descriptors for photos 1417907952 and 1417907962 LMissing descriptors for photos 1417907962 and 1417907963 LMissing descriptors for photos 1417907963 and 1417907964 LMissing descriptors for photos 1417907964 and 1417907965 LMissing descriptors for photos 1417907965 and 1417907966 LMissing descriptors for photos 1417907966 and 1417907967 LMissing descriptors for photos 1417907967 and 1417908025 LMissing descriptors for photos 1417908025 and 1417908028 LMissing descriptors for photos 1417908028 and 1417908030 LMissing descriptors for photos 1417908030 and 1417908033 LMissing descriptors for photos 1417908033 and 1417908036 LMissing descriptors for photos 1417908036 and 1417908039 LMissing descriptors for photos 1417908039 and 1417908263 LMissing descriptors for photos 1417908263 and 1417908264 LMissing descriptors for photos 1417908264 and 1417908265 LMissing descriptors for photos 1417908265 and 1417908266 LMissing descriptors for photos 1417908266 and 1417908267 LMissing descriptors for photos 1417908267 and 1417908268 LMissing descriptors for photos 1417908268 and 1417908280 LMissing descriptors for photos 1417908280 and 1417908281 LMissing descriptors for photos 1417908281 and 1417908282 LMissing descriptors for photos 1417908282 and 1417908283 LMissing descriptors for photos 1417908283 and 1417908284 LMissing descriptors for photos 1417908284 and 1417908285 LMissing descriptors for photos 1417908285 and 1417908377 LMissing descriptors for photos 1417908377 and 1417908380 LMissing descriptors for photos 1417908380 and 1417908402 LMissing descriptors for photos 1417908402 and 1417908404 LMissing descriptors for photos 1417908404 and 1417908384 LMissing descriptors for photos 1417908384 and 1417908386 LMissing descriptors for photos 1417908386 and 1417908405 LMissing descriptors for photos 1417908405 and 1417908406 LMissing descriptors for photos 1417908406 and 1417908409 LMissing descriptors for photos 1417908409 and 1417908411 LMissing descriptors for photos 1417908411 and 1417908502 LMissing descriptors for photos 1417908502 and 1417908503 LMissing descriptors for photos 1417908503 and 1417908504 LMissing descriptors for photos 1417908504 and 1417908508 LMissing descriptors for photos 1417908508 and 1417908510 LMissing descriptors for photos 1417908510 and 1417908514 LMissing descriptors for photos 1417908514 and 1417908947 LMissing descriptors for photos 1417908947 and 1417909003 LMissing descriptors for photos 1417909003 and 1417909050 LMissing descriptors for photos 1417909050 and 1417909096 LMissing descriptors for photos 1417909096 and 1417909144 LMissing descriptors for photos 1417909144 and 1417909190 LMissing descriptors for photos 1417909190 and 1417910250 LMissing descriptors for photos 1417910250 and 1417910251 LMissing descriptors for photos 1417910251 and 1417910252 LMissing descriptors for photos 1417910252 and 1417910253 LMissing descriptors for photos 1417910253 and 1417910254 LMissing descriptors for photos 1417910254 and 1417910255 LMissing descriptors for photos 1417910255 and 1417910283 LMissing descriptors for photos 1417910283 and 1417910285 LMissing descriptors for photos 1417910285 and 1417910286 LMissing descriptors for photos 1417910286 and 1417910287 LMissing descriptors for photos 1417910287 and 1417910290 LMissing descriptors for photos 1417910290 and 1417910294 LMissing descriptors for photos 1417910294 and 1417910390 LMissing descriptors for photos 1417910390 and 1417910395 LMissing descriptors for photos 1417910395 and 1417910397 LMissing descriptors for photos 1417910397 and 1417910400 LMissing descriptors for photos 1417910400 and 1417910403 LMissing descriptors for photos 1417910403 and 1417910404 LMissing descriptors for photos 1417910404 and 1417911248 LMissing descriptors for photos 1417911248 and 1417911306 LMissing descriptors for photos 1417911306 and 1417911359 LMissing descriptors for photos 1417911359 and 1417911413 LMissing descriptors for photos 1417911413 and 1417911467 LMissing descriptors for photos 1417911467 and 1417911521 LMissing descriptors for photos 1417911521 and 1417913347 LMissing descriptors for photos 1417913347 and 1417913365 LMissing descriptors for photos 1417913365 and 1417913348 LMissing descriptors for photos 1417913348 and 1417913349 LMissing descriptors for photos 1417913349 and 1417913367 LMissing descriptors for photos 1417913367 and 1417913370 LMissing descriptors for photos 1417913370 and 1417913351 LMissing descriptors for photos 1417913351 and 1417913372 LMissing descriptors for photos 1417913372 and 1417913375 LMissing descriptors for photos 1417913375 and 1417913377 LMissing descriptors for photos 1417913377 and 1417913427 LMissing descriptors for photos 1417913427 and 1417913428 LMissing descriptors for photos 1417913428 and 1417913429 LMissing descriptors for photos 1417913429 and 1417913431 LMissing descriptors for photos 1417913431 and 1417913432 LMissing descriptors for photos 1417913432 and 1417913433 LMissing descriptors for photos 1417913433 and 1417913461 LMissing descriptors for photos 1417913461 and 1417913462 LMissing descriptors for photos 1417913462 and 1417913463 LMissing descriptors for photos 1417913463 and 1417913464 LMissing descriptors for photos 1417913464 and 1417913465 LMissing descriptors for photos 1417913465 and 1417913466 LMissing descriptors for photos 1417913466 and 1417913494 LMissing descriptors for photos 1417913494 and 1417913495 LMissing descriptors for photos 1417913495 and 1417913496 LMissing descriptors for photos 1417913496 and 1417913497 LMissing descriptors for photos 1417913497 and 1417913498 LMissing descriptors for photos 1417913498 and 1417913499 LMissing descriptors for photos 1417913499 and 1417913599 LMissing descriptors for photos 1417913599 and 1417913600 LMissing descriptors for photos 1417913600 and 1417913601 LMissing descriptors for photos 1417913601 and 1417913605 LMissing descriptors for photos 1417913605 and 1417913606 LMissing descriptors for photos 1417913606 and 1417913607 LMissing descriptors for photos 1417913607 and 1417913602 LMissing descriptors for photos 1417913602 and 1417913603 LMissing descriptors for photos 1417913603 and 1417913608 LMissing descriptors for photos 1417913608 and 1417913610 LMissing descriptors for photos 1417913610 and 1417913612 LMissing descriptors for photos 1417913612 and 1417913672 LMissing descriptors for photos 1417913672 and 1417913674 LMissing descriptors for photos 1417913674 and 1417913675 LMissing descriptors for photos 1417913675 and 1417913677 LMissing descriptors for photos 1417913677 and 1417913678 LMissing descriptors for photos 1417913678 and 1417913679 LMissing descriptors for photos 1417913679 and 1417915231 LMissing descriptors for photos 1417915231 and 1417915232 LMissing descriptors for photos 1417915232 and 1417915233 LMissing descriptors for photos 1417915233 and 1417915234 LMissing descriptors for photos 1417915234 and 1417915235 LMissing descriptors for photos 1417915235 and 1417915236 LMissing descriptors for photos 1417915236 and 1417915251 LMissing descriptors for photos 1417915251 and 1417915252 LMissing descriptors for photos 1417915252 and 1417915253 LMissing descriptors for photos 1417915253 and 1417915254 LMissing descriptors for photos 1417915254 and 1417915255 LMissing descriptors for photos 1417915255 and 1417915256 LMissing descriptors for photos 1417915256 and 1417915267 LMissing descriptors for photos 1417915267 and 1417915268 LMissing descriptors for photos 1417915268 and 1417915269 LMissing descriptors for photos 1417915269 and 1417915270 LMissing descriptors for photos 1417915270 and 1417915271 LMissing descriptors for photos 1417915271 and 1417915272 LMissing descriptors for photos 1417915272 and 1417915292 LMissing descriptors for photos 1417915292 and 1417915293 LMissing descriptors for photos 1417915293 and 1417915294 LMissing descriptors for photos 1417915294 and 1417915297 LMissing descriptors for photos 1417915297 and 1417915298 LMissing descriptors for photos 1417915298 and 1417915299 LMissing descriptors for photos 1417915299 and 1417915295 LMissing descriptors for photos 1417915295 and 1417915300 LMissing descriptors for photos 1417915300 and 1417915303 LMissing descriptors for photos 1417915303 and 1417915304 LMissing descriptors for photos 1417915304 and 1417915321 LMissing descriptors for photos 1417915321 and 1417915322 LMissing descriptors for photos 1417915322 and 1417915323 LMissing descriptors for photos 1417915323 and 1417915324 LMissing descriptors for photos 1417915324 and 1417915325 LMissing descriptors for photos 1417915325 and 1417915326 LMissing descriptors for photos 1417915326 and 1417915339 LMissing descriptors for photos 1417915339 and 1417915341 LMissing descriptors for photos 1417915341 and 1417915342 LMissing descriptors for photos 1417915342 and 1417915343 LMissing descriptors for photos 1417915343 and 1417915344 LMissing descriptors for photos 1417915344 and 1417915345 LMissing descriptors for photos 1417915345 and 1417915355 LMissing descriptors for photos 1417915355 and 1417915357 LMissing descriptors for photos 1417915357 and 1417915358 LMissing descriptors for photos 1417915358 and 1417915359 LMissing descriptors for photos 1417915359 and 1417915360 LMissing descriptors for photos 1417915360 and 1417915361 L 14092026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 201 time used for this insertion : 0.11893177032470703 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.2129192352294922 To do, maybe not at the correct place ! .L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.024006366729736328 NUMBER BATCH : 3 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! We have rejected 9 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 0.07407593727111816 # DISPLAY ALL COLLECTED DATA : {'14092026': {'nb_upload': 201, 'nb_taggue_class': 0, 'nb_taggue_densite': 0, 'nb_descriptors': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1417915361, 1417915360, 1417915359, 1417915358, 1417915357, 1417915355, 1417915345, 1417915344, 1417915343, 1417915342, 1417915341, 1417915339, 1417915326, 1417915325, 1417915324, 1417915323, 1417915322, 1417915321, 1417915304, 1417915303, 1417915300, 1417915299, 1417915298, 1417915297, 1417915295, 1417915294, 1417915293, 1417915292, 1417915272, 1417915271, 1417915270, 1417915269, 1417915268, 1417915267, 1417915256, 1417915255, 1417915254, 1417915253, 1417915252, 1417915251, 1417915236, 1417915235, 1417915234, 1417915233, 1417915232, 1417915231, 1417913679, 1417913678, 1417913677, 1417913675, 1417913674, 1417913672, 1417913612, 1417913610, 1417913608, 1417913607, 1417913606, 1417913605, 1417913603, 1417913602, 1417913601, 1417913600, 1417913599, 1417913499, 1417913498, 1417913497, 1417913496, 1417913495, 1417913494, 1417913466, 1417913465, 1417913464, 1417913463, 1417913462, 1417913461, 1417913433, 1417913432, 1417913431, 1417913429, 1417913428, 1417913427, 1417913377, 1417913375, 1417913372, 1417913370, 1417913367, 1417913365, 1417913351, 1417913349, 1417913348, 1417913347, 1417911521, 1417911467, 1417911413, 1417911359, 1417911306, 1417911248, 1417910404, 1417910403, 1417910400] Looping around the photos to save general results len do output : 1 /31166259Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915361', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915360', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915359', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915358', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915357', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915355', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915345', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915344', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915343', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915342', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915341', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915339', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915326', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915325', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915324', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915323', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915322', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915321', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915304', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915303', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915300', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915299', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915298', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915297', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915295', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915294', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915293', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915292', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915272', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915271', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915270', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915269', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915268', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915267', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915256', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915255', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915254', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915253', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915252', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915251', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915236', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915235', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915234', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915233', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915232', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417915231', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913679', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913678', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913677', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913675', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913674', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913672', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913612', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913610', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913608', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913607', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913606', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913605', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913603', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913602', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913601', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913600', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913599', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913499', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913498', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913497', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913496', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913495', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913494', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913466', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913465', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913464', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913463', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913462', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913461', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913433', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913432', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913431', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913429', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913428', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913427', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913377', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913375', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913372', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913370', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913367', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913365', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913351', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913349', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913348', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417913347', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417911521', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417911467', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417911413', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417911359', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417911306', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417911248', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417910404', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417910403', None, None, None, None, None, '4389432') ('4189', None, None, None, None, None, None, None, '4389432') ('4189', '31166259', '1417910400', None, None, None, None, None, '4389432') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.04215383529663086 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.343008041381836 time spend to save output : 0.042917728424072266 total time spend for step 1 : 1.3859257698059082 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.44user 0.67system 0:06.09elapsed 34%CPU (0avgtext+0avgdata 112660maxresident)k 712inputs+80outputs (13major+58191minor)pagefaults 0swaps