python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 183951 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Date 2026-03-13 13:00:28.573211 Current got : datou_id : 4189, datou_cur_ids : ['4361370'] with mtr_portfolio_ids : ['30735591'] and first list_photo_ids : [] new path : /proc/183951/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.021842479705810547 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Fri Mar 13 13:00:28 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 124),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 119} L13032026 30735591 Nombre de photos uploadées : 124 / 23040 (0%) 13032026 30735591 Nombre de photos taguées (types de déchets): 119 / 124 (95%) 13032026 30735591 Nombre de photos taguées (volume) : 119 / 124 (95%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 7.843971252441406e-05 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL????? elapsed_time : fill_and_build_computed_from_old_data 0.008836984634399414 LCatched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22304487228393555 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.045204877853393555 Creating list_photo_total Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412044780.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412044940.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412044985.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412045001.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412045003.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412045032.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412045033.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412045835.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412045836.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412045838.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412046344.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412046346.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412046480.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412046481.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412046482.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049250.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049251.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049252.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049253.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049254.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049255.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049585.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049586.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049587.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049588.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049589.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049590.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049598.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049599.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049600.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049601.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049602.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049603.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049621.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049622.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049623.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049624.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049625.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049626.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049659.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049661.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049677.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049680.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049682.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049684.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049707.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049708.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049709.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049710.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049711.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412049712.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052560.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052561.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052562.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052563.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052564.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052565.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052631.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052633.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052634.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052635.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052636.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052637.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052663.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052666.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052668.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052669.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052670.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052671.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052700.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052701.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052702.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052703.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052704.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052705.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052773.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052774.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052775.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052776.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052777.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412052778.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412054230.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412054286.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412054379.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412054440.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412054469.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1412054490.desc 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' Unable to find some descriptors in ovh, trying to find them in s3 Number missing : 87 Warning this was a bad idea s3 ! elapsed_time : select_descriptors 11.734720706939697 Missing descriptors : 87 13032026 30735591 Nombre de photos avec descriptors (type 5680) : 7 / 99 (7%) Missing descriptors for photos 0 and 1412044723 L0:00:00|ON:Missing descriptors for photos 1412044723 and 1412044773 LMissing descriptors for photos 1412044773 and 1412044780 Missing descriptors for photos 1412044780 and 1412044826 LMissing descriptors for photos 1412044826 and 1412044936 LMissing descriptors for photos 1412044936 and 1412044937 LMissing descriptors for photos 1412044937 and 1412044938 LMissing descriptors for photos 1412044938 and 1412044939 LMissing descriptors for photos 1412044939 and 1412044940 Missing descriptors for photos 1412044940 and 1412044942 LMissing descriptors for photos 1412044942 and 1412044980 LMissing descriptors for photos 1412044980 and 1412044981 LMissing descriptors for photos 1412044981 and 1412044982 LMissing descriptors for photos 1412044982 and 1412044983 LMissing descriptors for photos 1412044983 and 1412044984 LMissing descriptors for photos 1412044984 and 1412044985 Missing descriptors for photos 1412044985 and 1412045000 LMissing descriptors for photos 1412045000 and 1412045001 Missing descriptors for photos 1412045001 and 1412045002 LMissing descriptors for photos 1412045002 and 1412045003 Missing descriptors for photos 1412045003 and 1412045004 LMissing descriptors for photos 1412045004 and 1412045005 LMissing descriptors for photos 1412045005 and 1412045026 LMissing descriptors for photos 1412045026 and 1412045028 LMissing descriptors for photos 1412045028 and 1412045030 LMissing descriptors for photos 1412045030 and 1412045032 Missing descriptors for photos 1412045032 and 1412045033 Missing descriptors for photos 1412045033 and 1412045034 LMissing descriptors for photos 1412045034 and 1412045834 LMissing descriptors for photos 1412045834 and 1412045835 Missing descriptors for photos 1412045835 and 1412045836 Missing descriptors for photos 1412045836 and 1412045837 LMissing descriptors for photos 1412045837 and 1412045838 Missing descriptors for photos 1412045838 and 1412045840 LMissing descriptors for photos 1412045840 and 1412046344 Missing descriptors for photos 1412046344 and 1412046345 LMissing descriptors for photos 1412046345 and 1412046346 Missing descriptors for photos 1412046346 and 1412046480 Missing descriptors for photos 1412046480 and 1412046481 Missing descriptors for photos 1412046481 and 1412046482 ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1412046980 photo_id_prec : 1412046482 ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1412049250 photo_id_prec : 1412046989 Missing descriptors for photos 1412049250 and 1412049251 Missing descriptors for photos 1412049251 and 1412049252 Missing descriptors for photos 1412049252 and 1412049253 Missing descriptors for photos 1412049253 and 1412049254 Missing descriptors for photos 1412049254 and 1412049255 Missing descriptors for photos 1412049255 and 1412049585 Missing descriptors for photos 1412049585 and 1412049586 Missing descriptors for photos 1412049586 and 1412049587 Missing descriptors for photos 1412049587 and 1412049588 Missing descriptors for photos 1412049588 and 1412049589 Missing descriptors for photos 1412049589 and 1412049590 Missing descriptors for photos 1412049590 and 1412049598 Missing descriptors for photos 1412049598 and 1412049599 Missing descriptors for photos 1412049599 and 1412049600 Missing descriptors for photos 1412049600 and 1412049601 Missing descriptors for photos 1412049601 and 1412049602 Missing descriptors for photos 1412049602 and 1412049603 Missing descriptors for photos 1412049603 and 1412049621 Missing descriptors for photos 1412049621 and 1412049622 Missing descriptors for photos 1412049622 and 1412049623 Missing descriptors for photos 1412049623 and 1412049624 Missing descriptors for photos 1412049624 and 1412049625 Missing descriptors for photos 1412049625 and 1412049626 Missing descriptors for photos 1412049626 and 1412049659 Missing descriptors for photos 1412049659 and 1412049661 Missing descriptors for photos 1412049661 and 1412049677 Missing descriptors for photos 1412049677 and 1412049680 Missing descriptors for photos 1412049680 and 1412049682 Missing descriptors for photos 1412049682 and 1412049684 Missing descriptors for photos 1412049684 and 1412049707 Missing descriptors for photos 1412049707 and 1412049708 Missing descriptors for photos 1412049708 and 1412049709 Missing descriptors for photos 1412049709 and 1412049710 Missing descriptors for photos 1412049710 and 1412049711 Missing descriptors for photos 1412049711 and 1412049712 ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1412049742 photo_id_prec : 1412049712 ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1412052560 photo_id_prec : 1412049908 Missing descriptors for photos 1412052560 and 1412052561 Missing descriptors for photos 1412052561 and 1412052562 Missing descriptors for photos 1412052562 and 1412052563 Missing descriptors for photos 1412052563 and 1412052564 Missing descriptors for photos 1412052564 and 1412052565 Missing descriptors for photos 1412052565 and 1412052631 Missing descriptors for photos 1412052631 and 1412052633 Missing descriptors for photos 1412052633 and 1412052634 Missing descriptors for photos 1412052634 and 1412052635 Missing descriptors for photos 1412052635 and 1412052636 Missing descriptors for photos 1412052636 and 1412052637 LMissing descriptors for photos 1412052637 and 1412052663 LMissing descriptors for photos 1412052663 and 1412052666 LMissing descriptors for photos 1412052666 and 1412052668 LMissing descriptors for photos 1412052668 and 1412052669 LMissing descriptors for photos 1412052669 and 1412052670 LMissing descriptors for photos 1412052670 and 1412052671 LMissing descriptors for photos 1412052671 and 1412052700 LMissing descriptors for photos 1412052700 and 1412052701 LMissing descriptors for photos 1412052701 and 1412052702 LMissing descriptors for photos 1412052702 and 1412052703 LMissing descriptors for photos 1412052703 and 1412052704 LMissing descriptors for photos 1412052704 and 1412052705 LMissing descriptors for photos 1412052705 and 1412052773 LMissing descriptors for photos 1412052773 and 1412052774 LMissing descriptors for photos 1412052774 and 1412052775 LMissing descriptors for photos 1412052775 and 1412052776 LMissing descriptors for photos 1412052776 and 1412052777 LMissing descriptors for photos 1412052777 and 1412052778 LMissing descriptors for photos 1412052778 and 1412054230 LMissing descriptors for photos 1412054230 and 1412054286 LMissing descriptors for photos 1412054286 and 1412054379 LMissing descriptors for photos 1412054379 and 1412054440 LMissing descriptors for photos 1412054440 and 1412054469 LMissing descriptors for photos 1412054469 and 1412054490 LMissing descriptors for photos 1412054490 and 1412055657 LMissing descriptors for photos 1412055657 and 1412055658 LMissing descriptors for photos 1412055658 and 1412055659 LMissing descriptors for photos 1412055659 and 1412055661 LMissing descriptors for photos 1412055661 and 1412055714 L 13032026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 124 time used for this insertion : 0.02708745002746582 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.05736899375915527 To do, maybe not at the correct place ! .L.L..L.L.L.L.L..L.L.L.L.L.L..L..L..L.L.L.L.L...L.L...L..L..L...........................................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.008154869079589844 NUMBER BATCH : 2 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] result_one_balle_Type_JRM:{'day': '13032026', 'map_nb_amount': {0: 7, 1: 55, 2: 0, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.308079957962, 'nb_balles_papier': 0.0006900000000000012, 'begin_time_port': 'image_13032026_10_00_03_003729m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0006900000000000012 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info LLresult_one_balle_Type_JRM:{'day': '13032026', 'map_nb_amount': {0: 2, 1: 21, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 239.39120292663574, 'nb_balles_papier': 0.00025, 'begin_time_port': 'image_13032026_10_15_03_140435_0000.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.00025 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 2 list_same_port_ids : [] list_same_port_ids : [] # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30737343 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30737344 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 6.048752784729004 # DISPLAY ALL COLLECTED DATA : {'13032026': {'nb_upload': 124, 'nb_taggue_class': 119, 'nb_taggue_densite': 119, 'nb_descriptors': 7}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1412055714, 1412055661, 1412055659, 1412055658, 1412055657, 1412054490, 1412054469, 1412054440, 1412054379, 1412054286, 1412054230, 1412052778, 1412052777, 1412052776, 1412052775, 1412052774, 1412052773, 1412052705, 1412052704, 1412052703, 1412052702, 1412052701, 1412052700, 1412052671, 1412052670, 1412052669, 1412052668, 1412052666, 1412052663, 1412052637, 1412052636, 1412052635, 1412052634, 1412052633, 1412052631, 1412052565, 1412052564, 1412052563, 1412052562, 1412052561, 1412052560, 1412049908, 1412049848, 1412049797, 1412049742, 1412049712, 1412049711, 1412049710, 1412049709, 1412049708, 1412049707, 1412049684, 1412049682, 1412049680, 1412049677, 1412049661, 1412049659, 1412049626, 1412049625, 1412049624, 1412049623, 1412049622, 1412049621, 1412049603, 1412049602, 1412049601, 1412049600, 1412049599, 1412049598, 1412049590, 1412049589, 1412049588, 1412049587, 1412049586, 1412049585, 1412049255, 1412049254, 1412049253, 1412049252, 1412049251, 1412049250, 1412046989, 1412046987, 1412046980, 1412046482, 1412046481, 1412046480, 1412046346, 1412046345, 1412046344, 1412045840, 1412045838, 1412045837, 1412045836, 1412045835, 1412045834, 1412045034, 1412045033, 1412045032, 1412045030] Looping around the photos to save general results len do output : 1 /30735591Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412055714', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412055661', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412055659', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412055658', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412055657', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412054490', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412054469', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412054440', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412054379', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412054286', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412054230', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052778', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052777', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052776', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052775', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052774', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052773', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052705', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052704', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052703', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052702', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052701', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052700', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052671', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052670', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052669', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052668', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052666', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052663', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052637', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052636', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052635', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052634', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052633', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052631', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052565', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052564', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052563', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052562', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052561', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412052560', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049908', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049848', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049797', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049742', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049712', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049711', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049710', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049709', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049708', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049707', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049684', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049682', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049680', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049677', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049661', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049659', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049626', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049625', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049624', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049623', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049622', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049621', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049603', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049602', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049601', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049600', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049599', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049598', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049590', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049589', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049588', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049587', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049586', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049585', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049255', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049254', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049253', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049252', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049251', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412049250', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046989', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046987', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046980', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046482', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046481', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046480', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046346', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046345', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412046344', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045840', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045838', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045837', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045836', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045835', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045834', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045034', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045033', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045032', None, None, None, None, None, '4361370') ('4189', None, None, None, None, None, None, None, '4361370') ('4189', '30735591', '1412045030', None, None, None, None, None, '4361370') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.02904534339904785 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.226954698562622 time spend to save output : 0.030050039291381836 total time spend for step 1 : 18.257004737854004 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.62user 0.60system 0:21.39elapsed 10%CPU (0avgtext+0avgdata 111448maxresident)k 56inputs+208outputs (11major+52734minor)pagefaults 0swaps