local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 Detection mask done ! Trying to reset tf kernel 4011800 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005421638488769531 nb_pixel_total : 13564 time to create 1 rle with old method : 0.014775514602661133 length of segment : 153 time for calcul the mask position with numpy : 0.0005414485931396484 nb_pixel_total : 26727 time to create 1 rle with old method : 0.028414249420166016 length of segment : 308 time for calcul the mask position with numpy : 0.0005054473876953125 nb_pixel_total : 25870 time to create 1 rle with old method : 0.0275876522064209 length of segment : 225 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 9396 time to create 1 rle with old method : 0.010174751281738281 length of segment : 93 time for calcul the mask position with numpy : 0.0004317760467529297 nb_pixel_total : 22646 time to create 1 rle with old method : 0.024358034133911133 length of segment : 158 time for calcul the mask position with numpy : 0.00026226043701171875 nb_pixel_total : 10414 time to create 1 rle with old method : 0.011093854904174805 length of segment : 138 time for calcul the mask position with numpy : 0.001108407974243164 nb_pixel_total : 58543 time to create 1 rle with old method : 0.06113576889038086 length of segment : 325 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 13556 time to create 1 rle with old method : 0.015222549438476562 length of segment : 137 time for calcul the mask position with numpy : 0.00012874603271484375 nb_pixel_total : 7261 time to create 1 rle with old method : 0.00778508186340332 length of segment : 89 time for calcul the mask position with numpy : 0.004364013671875 nb_pixel_total : 208240 time to create 1 rle with new method : 0.009407997131347656 length of segment : 502 time for calcul the mask position with numpy : 0.00043845176696777344 nb_pixel_total : 11478 time to create 1 rle with old method : 0.017882823944091797 length of segment : 135 time for calcul the mask position with numpy : 1.0983645915985107 nb_pixel_total : 874613 time to create 1 rle with new method : 0.0699467658996582 length of segment : 1069 time for calcul the mask position with numpy : 0.008058786392211914 nb_pixel_total : 570856 time to create 1 rle with new method : 0.3347446918487549 length of segment : 905 time for calcul the mask position with numpy : 0.0026023387908935547 nb_pixel_total : 226735 time to create 1 rle with new method : 0.00561070442199707 length of segment : 490 time for calcul the mask position with numpy : 0.0027174949645996094 nb_pixel_total : 242432 time to create 1 rle with new method : 0.006146907806396484 length of segment : 407 time for calcul the mask position with numpy : 0.007052898406982422 nb_pixel_total : 549878 time to create 1 rle with new method : 0.031847238540649414 length of segment : 750 time for calcul the mask position with numpy : 0.006814479827880859 nb_pixel_total : 248531 time to create 1 rle with new method : 0.03268837928771973 length of segment : 760 time for calcul the mask position with numpy : 0.002885580062866211 nb_pixel_total : 150033 time to create 1 rle with new method : 0.0035889148712158203 length of segment : 776 time for calcul the mask position with numpy : 0.0016264915466308594 nb_pixel_total : 60440 time to create 1 rle with old method : 0.06693601608276367 length of segment : 128 time for calcul the mask position with numpy : 0.001922607421875 nb_pixel_total : 43422 time to create 1 rle with old method : 0.04694557189941406 length of segment : 275 time for calcul the mask position with numpy : 0.0016543865203857422 nb_pixel_total : 47292 time to create 1 rle with old method : 0.05198407173156738 length of segment : 258 time for calcul the mask position with numpy : 0.0049474239349365234 nb_pixel_total : 183917 time to create 1 rle with new method : 0.007216930389404297 length of segment : 427 time for calcul the mask position with numpy : 0.002780914306640625 nb_pixel_total : 92430 time to create 1 rle with old method : 0.09764361381530762 length of segment : 496 time for calcul the mask position with numpy : 0.013477563858032227 nb_pixel_total : 505671 time to create 1 rle with new method : 0.03436470031738281 length of segment : 969 time for calcul the mask position with numpy : 0.006206035614013672 nb_pixel_total : 220865 time to create 1 rle with new method : 0.010410547256469727 length of segment : 308 time for calcul the mask position with numpy : 0.0018010139465332031 nb_pixel_total : 59735 time to create 1 rle with old method : 0.06361079216003418 length of segment : 271 time for calcul the mask position with numpy : 0.0007717609405517578 nb_pixel_total : 28077 time to create 1 rle with old method : 0.03221487998962402 length of segment : 112 time for calcul the mask position with numpy : 0.0013883113861083984 nb_pixel_total : 31887 time to create 1 rle with old method : 0.036255836486816406 length of segment : 239 time for calcul the mask position with numpy : 0.0012869834899902344 nb_pixel_total : 25440 time to create 1 rle with old method : 0.028542280197143555 length of segment : 314 time for calcul the mask position with numpy : 0.0026786327362060547 nb_pixel_total : 111799 time to create 1 rle with old method : 0.11820101737976074 length of segment : 427 time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 8731 time to create 1 rle with old method : 0.009233236312866211 length of segment : 121 time for calcul the mask position with numpy : 0.0018856525421142578 nb_pixel_total : 51475 time to create 1 rle with old method : 0.05612897872924805 length of segment : 384 time for calcul the mask position with numpy : 0.0055010318756103516 nb_pixel_total : 156675 time to create 1 rle with new method : 0.007946968078613281 length of segment : 520 time for calcul the mask position with numpy : 0.0005748271942138672 nb_pixel_total : 20943 time to create 1 rle with old method : 0.0344393253326416 length of segment : 232 time for calcul the mask position with numpy : 0.0007424354553222656 nb_pixel_total : 18400 time to create 1 rle with old method : 0.020016908645629883 length of segment : 178 time for calcul the mask position with numpy : 0.0006990432739257812 nb_pixel_total : 23145 time to create 1 rle with old method : 0.025607585906982422 length of segment : 161 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 8227 time to create 1 rle with old method : 0.009090423583984375 length of segment : 89 time for calcul the mask position with numpy : 0.0068874359130859375 nb_pixel_total : 277291 time to create 1 rle with new method : 0.010845184326171875 length of segment : 607 time for calcul the mask position with numpy : 0.001878976821899414 nb_pixel_total : 56854 time to create 1 rle with old method : 0.061721086502075195 length of segment : 302 time for calcul the mask position with numpy : 0.0017209053039550781 nb_pixel_total : 28594 time to create 1 rle with old method : 0.031907081604003906 length of segment : 528 time for calcul the mask position with numpy : 0.0017101764678955078 nb_pixel_total : 44744 time to create 1 rle with old method : 0.04885435104370117 length of segment : 273 time for calcul the mask position with numpy : 0.021247148513793945 nb_pixel_total : 514040 time to create 1 rle with new method : 0.2126152515411377 length of segment : 1660 time for calcul the mask position with numpy : 0.0003323554992675781 nb_pixel_total : 10970 time to create 1 rle with old method : 0.012289047241210938 length of segment : 117 time for calcul the mask position with numpy : 0.00043010711669921875 nb_pixel_total : 13943 time to create 1 rle with old method : 0.015944957733154297 length of segment : 98 time for calcul the mask position with numpy : 0.008382081985473633 nb_pixel_total : 207899 time to create 1 rle with new method : 0.01223134994506836 length of segment : 662 time for calcul the mask position with numpy : 0.002502918243408203 nb_pixel_total : 67369 time to create 1 rle with old method : 0.07450485229492188 length of segment : 417 time for calcul the mask position with numpy : 0.0008137226104736328 nb_pixel_total : 14841 time to create 1 rle with old method : 0.01650381088256836 length of segment : 282 time for calcul the mask position with numpy : 0.003365039825439453 nb_pixel_total : 118995 time to create 1 rle with old method : 0.12997698783874512 length of segment : 392 time for calcul the mask position with numpy : 0.0014286041259765625 nb_pixel_total : 33617 time to create 1 rle with old method : 0.037436485290527344 length of segment : 244 time for calcul the mask position with numpy : 0.0016112327575683594 nb_pixel_total : 51538 time to create 1 rle with old method : 0.05778026580810547 length of segment : 316 time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 8849 time to create 1 rle with old method : 0.009860754013061523 length of segment : 110 time for calcul the mask position with numpy : 0.0012543201446533203 nb_pixel_total : 26463 time to create 1 rle with old method : 0.029210805892944336 length of segment : 368 time for calcul the mask position with numpy : 0.0008907318115234375 nb_pixel_total : 25485 time to create 1 rle with old method : 0.028078079223632812 length of segment : 149 time for calcul the mask position with numpy : 0.00038814544677734375 nb_pixel_total : 8101 time to create 1 rle with old method : 0.00939178466796875 length of segment : 85 time for calcul the mask position with numpy : 0.0015828609466552734 nb_pixel_total : 46979 time to create 1 rle with old method : 0.0521087646484375 length of segment : 225 time for calcul the mask position with numpy : 0.0027933120727539062 nb_pixel_total : 104766 time to create 1 rle with old method : 0.1118767261505127 length of segment : 330 time for calcul the mask position with numpy : 0.002806425094604492 nb_pixel_total : 55618 time to create 1 rle with old method : 0.06190061569213867 length of segment : 487 time for calcul the mask position with numpy : 0.0020995140075683594 nb_pixel_total : 43069 time to create 1 rle with old method : 0.04781007766723633 length of segment : 373 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 12281 time to create 1 rle with old method : 0.013583660125732422 length of segment : 129 time for calcul the mask position with numpy : 0.0018544197082519531 nb_pixel_total : 72890 time to create 1 rle with old method : 0.07831573486328125 length of segment : 213 time for calcul the mask position with numpy : 0.00096893310546875 nb_pixel_total : 26604 time to create 1 rle with old method : 0.030551910400390625 length of segment : 168 time for calcul the mask position with numpy : 0.000537872314453125 nb_pixel_total : 11913 time to create 1 rle with old method : 0.012994050979614258 length of segment : 137 time for calcul the mask position with numpy : 0.0008707046508789062 nb_pixel_total : 21307 time to create 1 rle with old method : 0.028099775314331055 length of segment : 143 time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 1939 time to create 1 rle with old method : 0.0025484561920166016 length of segment : 100 time for calcul the mask position with numpy : 0.006337404251098633 nb_pixel_total : 209233 time to create 1 rle with new method : 0.008410215377807617 length of segment : 477 time for calcul the mask position with numpy : 0.0016448497772216797 nb_pixel_total : 64860 time to create 1 rle with old method : 0.07003140449523926 length of segment : 275 time for calcul the mask position with numpy : 0.001287698745727539 nb_pixel_total : 23424 time to create 1 rle with old method : 0.025463581085205078 length of segment : 295 time for calcul the mask position with numpy : 0.0005543231964111328 nb_pixel_total : 10409 time to create 1 rle with old method : 0.011770009994506836 length of segment : 135 time for calcul the mask position with numpy : 0.0014348030090332031 nb_pixel_total : 32123 time to create 1 rle with old method : 0.03578925132751465 length of segment : 239 time for calcul the mask position with numpy : 0.0018172264099121094 nb_pixel_total : 42603 time to create 1 rle with old method : 0.047688961029052734 length of segment : 266 time for calcul the mask position with numpy : 0.0009334087371826172 nb_pixel_total : 24732 time to create 1 rle with old method : 0.02748394012451172 length of segment : 202 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 4673 time to create 1 rle with old method : 0.005621194839477539 length of segment : 78 time for calcul the mask position with numpy : 0.0006341934204101562 nb_pixel_total : 11661 time to create 1 rle with old method : 0.013512849807739258 length of segment : 156 time for calcul the mask position with numpy : 0.0012078285217285156 nb_pixel_total : 17172 time to create 1 rle with old method : 0.019128799438476562 length of segment : 197 time for calcul the mask position with numpy : 0.0005249977111816406 nb_pixel_total : 13164 time to create 1 rle with old method : 0.014963388442993164 length of segment : 109 time for calcul the mask position with numpy : 0.0006706714630126953 nb_pixel_total : 13657 time to create 1 rle with old method : 0.017317771911621094 length of segment : 161 time for calcul the mask position with numpy : 0.002420186996459961 nb_pixel_total : 61142 time to create 1 rle with old method : 0.06796145439147949 length of segment : 323 time for calcul the mask position with numpy : 0.0008122920989990234 nb_pixel_total : 16438 time to create 1 rle with old method : 0.01871013641357422 length of segment : 233 time for calcul the mask position with numpy : 0.004578113555908203 nb_pixel_total : 132025 time to create 1 rle with old method : 0.14492464065551758 length of segment : 455 time for calcul the mask position with numpy : 0.0009562969207763672 nb_pixel_total : 21807 time to create 1 rle with old method : 0.02445054054260254 length of segment : 199 time for calcul the mask position with numpy : 0.0005855560302734375 nb_pixel_total : 13058 time to create 1 rle with old method : 0.014903783798217773 length of segment : 141 time for calcul the mask position with numpy : 0.0025963783264160156 nb_pixel_total : 59062 time to create 1 rle with old method : 0.08848929405212402 length of segment : 311 time for calcul the mask position with numpy : 0.0029366016387939453 nb_pixel_total : 105145 time to create 1 rle with old method : 0.14120984077453613 length of segment : 486 time for calcul the mask position with numpy : 0.00218963623046875 nb_pixel_total : 59187 time to create 1 rle with old method : 0.0702047348022461 length of segment : 316 time for calcul the mask position with numpy : 0.001077413558959961 nb_pixel_total : 25763 time to create 1 rle with old method : 0.029274463653564453 length of segment : 231 time for calcul the mask position with numpy : 0.002537250518798828 nb_pixel_total : 50881 time to create 1 rle with old method : 0.05576753616333008 length of segment : 466 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 18295 time to create 1 rle with old method : 0.02103400230407715 length of segment : 154 time for calcul the mask position with numpy : 0.0007867813110351562 nb_pixel_total : 18477 time to create 1 rle with old method : 0.021117448806762695 length of segment : 158 time for calcul the mask position with numpy : 0.0011222362518310547 nb_pixel_total : 27487 time to create 1 rle with old method : 0.030455350875854492 length of segment : 266 time for calcul the mask position with numpy : 0.0006988048553466797 nb_pixel_total : 17105 time to create 1 rle with old method : 0.019484996795654297 length of segment : 220 time for calcul the mask position with numpy : 0.0016226768493652344 nb_pixel_total : 58639 time to create 1 rle with old method : 0.06547760963439941 length of segment : 273 time for calcul the mask position with numpy : 0.001146554946899414 nb_pixel_total : 40132 time to create 1 rle with old method : 0.04460334777832031 length of segment : 233 time for calcul the mask position with numpy : 0.0017039775848388672 nb_pixel_total : 42742 time to create 1 rle with old method : 0.04725170135498047 length of segment : 252 time for calcul the mask position with numpy : 0.0005764961242675781 nb_pixel_total : 18782 time to create 1 rle with old method : 0.02133631706237793 length of segment : 163 time for calcul the mask position with numpy : 0.0008866786956787109 nb_pixel_total : 30317 time to create 1 rle with old method : 0.0335996150970459 length of segment : 251 time for calcul the mask position with numpy : 0.0004839897155761719 nb_pixel_total : 14004 time to create 1 rle with old method : 0.016065597534179688 length of segment : 123 time for calcul the mask position with numpy : 0.0006020069122314453 nb_pixel_total : 16163 time to create 1 rle with old method : 0.018465757369995117 length of segment : 155 time for calcul the mask position with numpy : 0.0009670257568359375 nb_pixel_total : 37297 time to create 1 rle with old method : 0.042435646057128906 length of segment : 180 time for calcul the mask position with numpy : 0.0009932518005371094 nb_pixel_total : 34432 time to create 1 rle with old method : 0.03952479362487793 length of segment : 253 time for calcul the mask position with numpy : 0.0006017684936523438 nb_pixel_total : 20044 time to create 1 rle with old method : 0.02358865737915039 length of segment : 127 time for calcul the mask position with numpy : 0.0005421638488769531 nb_pixel_total : 17893 time to create 1 rle with old method : 0.02077007293701172 length of segment : 117 time for calcul the mask position with numpy : 0.0002536773681640625 nb_pixel_total : 4655 time to create 1 rle with old method : 0.005558013916015625 length of segment : 76 time for calcul the mask position with numpy : 0.0002410411834716797 nb_pixel_total : 5209 time to create 1 rle with old method : 0.0063626766204833984 length of segment : 78 time for calcul the mask position with numpy : 0.0008296966552734375 nb_pixel_total : 18606 time to create 1 rle with old method : 0.022862672805786133 length of segment : 226 time for calcul the mask position with numpy : 0.004009723663330078 nb_pixel_total : 162492 time to create 1 rle with new method : 0.00638127326965332 length of segment : 426 time for calcul the mask position with numpy : 0.0003771781921386719 nb_pixel_total : 7556 time to create 1 rle with old method : 0.008787870407104492 length of segment : 98 time for calcul the mask position with numpy : 0.0012166500091552734 nb_pixel_total : 31819 time to create 1 rle with old method : 0.035277605056762695 length of segment : 204 time for calcul the mask position with numpy : 0.0006361007690429688 nb_pixel_total : 17499 time to create 1 rle with old method : 0.019855976104736328 length of segment : 131 time for calcul the mask position with numpy : 0.0008070468902587891 nb_pixel_total : 23720 time to create 1 rle with old method : 0.02595043182373047 length of segment : 158 time for calcul the mask position with numpy : 0.001138448715209961 nb_pixel_total : 33435 time to create 1 rle with old method : 0.03771090507507324 length of segment : 167 time for calcul the mask position with numpy : 0.0018639564514160156 nb_pixel_total : 48272 time to create 1 rle with old method : 0.05316329002380371 length of segment : 323 time for calcul the mask position with numpy : 0.002624034881591797 nb_pixel_total : 116583 time to create 1 rle with old method : 0.1293048858642578 length of segment : 447 time for calcul the mask position with numpy : 0.0004341602325439453 nb_pixel_total : 9474 time to create 1 rle with old method : 0.010783195495605469 length of segment : 117 time for calcul the mask position with numpy : 0.0006275177001953125 nb_pixel_total : 12771 time to create 1 rle with old method : 0.014771461486816406 length of segment : 107 time for calcul the mask position with numpy : 0.0006802082061767578 nb_pixel_total : 21248 time to create 1 rle with old method : 0.024197816848754883 length of segment : 133 time for calcul the mask position with numpy : 0.0010063648223876953 nb_pixel_total : 19390 time to create 1 rle with old method : 0.021884918212890625 length of segment : 320 time for calcul the mask position with numpy : 0.00109100341796875 nb_pixel_total : 24642 time to create 1 rle with old method : 0.027147531509399414 length of segment : 202 time for calcul the mask position with numpy : 0.0011377334594726562 nb_pixel_total : 26510 time to create 1 rle with old method : 0.03002166748046875 length of segment : 191 time for calcul the mask position with numpy : 0.0011479854583740234 nb_pixel_total : 28825 time to create 1 rle with old method : 0.03202414512634277 length of segment : 264 time for calcul the mask position with numpy : 0.00153350830078125 nb_pixel_total : 40216 time to create 1 rle with old method : 0.0440676212310791 length of segment : 180 time for calcul the mask position with numpy : 0.0013964176177978516 nb_pixel_total : 35249 time to create 1 rle with old method : 0.03843092918395996 length of segment : 200 time for calcul the mask position with numpy : 0.0007030963897705078 nb_pixel_total : 21506 time to create 1 rle with old method : 0.024185895919799805 length of segment : 187 time for calcul the mask position with numpy : 0.0016977787017822266 nb_pixel_total : 70767 time to create 1 rle with old method : 0.07825255393981934 length of segment : 245 time for calcul the mask position with numpy : 0.0008368492126464844 nb_pixel_total : 24039 time to create 1 rle with old method : 0.02727222442626953 length of segment : 171 time for calcul the mask position with numpy : 0.0013186931610107422 nb_pixel_total : 46853 time to create 1 rle with old method : 0.07051849365234375 length of segment : 158 time for calcul the mask position with numpy : 0.0002484321594238281 nb_pixel_total : 9312 time to create 1 rle with old method : 0.010882854461669922 length of segment : 89 time for calcul the mask position with numpy : 0.005910634994506836 nb_pixel_total : 221248 time to create 1 rle with new method : 0.010137557983398438 length of segment : 576 time for calcul the mask position with numpy : 0.002104520797729492 nb_pixel_total : 61197 time to create 1 rle with old method : 0.06770586967468262 length of segment : 384 time for calcul the mask position with numpy : 0.0010018348693847656 nb_pixel_total : 20797 time to create 1 rle with old method : 0.02371525764465332 length of segment : 241 time for calcul the mask position with numpy : 0.002260446548461914 nb_pixel_total : 92142 time to create 1 rle with old method : 0.10481572151184082 length of segment : 561 time for calcul the mask position with numpy : 0.002232074737548828 nb_pixel_total : 77150 time to create 1 rle with old method : 0.08769679069519043 length of segment : 537 time for calcul the mask position with numpy : 0.0014450550079345703 nb_pixel_total : 35835 time to create 1 rle with old method : 0.04097938537597656 length of segment : 220 time spent for convertir_results : 12.452461004257202 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 132 chid ids of type : 3594 Number RLEs to save : 38337 save missing photos in datou_result : time spend for datou_step_exec : 76.35239839553833 time spend to save output : 3.845067262649536 total time spend for step 1 : 80.19746565818787 step2:crop_condition Wed May 21 19:51:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 132 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 71 About to insert : list_path_to_insert length 71 new photo from crops ! About to upload 71 photos upload in portfolio : 3736932 init cache_photo without model_param we have 71 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747849932_4011197 we have uploaded 71 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.9951388835907 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747849958_4011197 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.8814733028411865 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747849966_4011197 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7737312316894531 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3736932 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747849983_4011197 we have uploaded 36 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.581430196762085 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747849993_4011197 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.093961000442505 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360104982, 1360100792, 1360100720, 1360100633, 1360099747, 1360099063, 1360098939, 1360098867, 1360098810, 1360098710] Looping around the photos to save general results len do output : 132 /1360137722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360137924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360138224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360104982', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100792', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100720', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100633', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099747', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099063', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098939', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098867', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098810', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098710', None, None, None, None, None, '2928625') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 406 time used for this insertion : 0.03286290168762207 save_final save missing photos in datou_result : time spend for datou_step_exec : 85.26712584495544 time spend to save output : 0.03823566436767578 total time spend for step 2 : 85.30536150932312 step3:rle_unique_nms_with_priority Wed May 21 19:53:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 132 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 4.921849250793457 time for calcul the mask position with numpy : 0.3734004497528076 nb_pixel_total : 6642545 time to create 1 rle with new method : 0.9041097164154053 time for calcul the mask position with numpy : 0.0202484130859375 nb_pixel_total : 11478 time to create 1 rle with old method : 0.012466907501220703 time for calcul the mask position with numpy : 0.02250504493713379 nb_pixel_total : 208240 time to create 1 rle with new method : 0.6243867874145508 time for calcul the mask position with numpy : 0.020987749099731445 nb_pixel_total : 7261 time to create 1 rle with old method : 0.0076448917388916016 time for calcul the mask position with numpy : 0.022354602813720703 nb_pixel_total : 13556 time to create 1 rle with old method : 0.014895200729370117 time for calcul the mask position with numpy : 0.021359920501708984 nb_pixel_total : 58543 time to create 1 rle with old method : 0.06379985809326172 time for calcul the mask position with numpy : 0.020993471145629883 nb_pixel_total : 10414 time to create 1 rle with old method : 0.011634111404418945 time for calcul the mask position with numpy : 0.025124549865722656 nb_pixel_total : 22646 time to create 1 rle with old method : 0.024526119232177734 time for calcul the mask position with numpy : 0.024953126907348633 nb_pixel_total : 9396 time to create 1 rle with old method : 0.010191917419433594 time for calcul the mask position with numpy : 0.02130722999572754 nb_pixel_total : 25870 time to create 1 rle with old method : 0.02785325050354004 time for calcul the mask position with numpy : 0.020839214324951172 nb_pixel_total : 26727 time to create 1 rle with old method : 0.029789447784423828 time for calcul the mask position with numpy : 0.025257349014282227 nb_pixel_total : 13564 time to create 1 rle with old method : 0.024374961853027344 create new chi : 2.4279348850250244 time to delete rle : 0.022925615310668945 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6686 TO DO : save crop sub photo not yet done ! save time : 0.4934711456298828 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 2.882049798965454 time for calcul the mask position with numpy : 0.4107346534729004 nb_pixel_total : 4192896 time to create 1 rle with new method : 0.6408917903900146 time for calcul the mask position with numpy : 0.024331092834472656 nb_pixel_total : 150033 time to create 1 rle with new method : 0.5565762519836426 time for calcul the mask position with numpy : 0.024974822998046875 nb_pixel_total : 248531 time to create 1 rle with new method : 0.6769289970397949 time for calcul the mask position with numpy : 0.03948521614074707 nb_pixel_total : 549878 time to create 1 rle with new method : 1.016845941543579 time for calcul the mask position with numpy : 0.03247475624084473 nb_pixel_total : 242432 time to create 1 rle with new method : 0.5094192028045654 time for calcul the mask position with numpy : 0.0322110652923584 nb_pixel_total : 226735 time to create 1 rle with new method : 0.569586992263794 time for calcul the mask position with numpy : 0.03567647933959961 nb_pixel_total : 565122 time to create 1 rle with new method : 0.5820538997650146 time for calcul the mask position with numpy : 0.040940284729003906 nb_pixel_total : 874613 time to create 1 rle with new method : 0.6237335205078125 create new chi : 6.02566385269165 time to delete rle : 0.0026128292083740234 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 12335 TO DO : save crop sub photo not yet done ! save time : 0.8491315841674805 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 4.7676920890808105 time for calcul the mask position with numpy : 0.5001177787780762 nb_pixel_total : 5639908 time to create 1 rle with new method : 0.7276108264923096 time for calcul the mask position with numpy : 0.02290177345275879 nb_pixel_total : 111799 time to create 1 rle with old method : 0.12246108055114746 time for calcul the mask position with numpy : 0.019740819931030273 nb_pixel_total : 24797 time to create 1 rle with old method : 0.027704477310180664 time for calcul the mask position with numpy : 0.01959061622619629 nb_pixel_total : 31887 time to create 1 rle with old method : 0.035927772521972656 time for calcul the mask position with numpy : 0.021337509155273438 nb_pixel_total : 28077 time to create 1 rle with old method : 0.030317306518554688 time for calcul the mask position with numpy : 0.022134065628051758 nb_pixel_total : 59735 time to create 1 rle with old method : 0.0630331039428711 time for calcul the mask position with numpy : 0.032640695571899414 nb_pixel_total : 220865 time to create 1 rle with new method : 1.190049409866333 time for calcul the mask position with numpy : 0.03799128532409668 nb_pixel_total : 505671 time to create 1 rle with new method : 0.5730793476104736 time for calcul the mask position with numpy : 0.034096717834472656 nb_pixel_total : 92430 time to create 1 rle with old method : 0.09676218032836914 time for calcul the mask position with numpy : 0.03392434120178223 nb_pixel_total : 183917 time to create 1 rle with new method : 0.4858665466308594 time for calcul the mask position with numpy : 0.03369498252868652 nb_pixel_total : 47292 time to create 1 rle with old method : 0.05179095268249512 time for calcul the mask position with numpy : 0.027178049087524414 nb_pixel_total : 43422 time to create 1 rle with old method : 0.04722476005554199 time for calcul the mask position with numpy : 0.022869348526000977 nb_pixel_total : 60440 time to create 1 rle with old method : 0.06533360481262207 create new chi : 4.450453281402588 time to delete rle : 0.0017096996307373047 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 10495 TO DO : save crop sub photo not yet done ! save time : 0.6959166526794434 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.889172315597534 time for calcul the mask position with numpy : 0.4712221622467041 nb_pixel_total : 5825761 time to create 1 rle with new method : 0.481656551361084 time for calcul the mask position with numpy : 0.02103257179260254 nb_pixel_total : 13943 time to create 1 rle with old method : 0.015160799026489258 time for calcul the mask position with numpy : 0.020455598831176758 nb_pixel_total : 10111 time to create 1 rle with old method : 0.011029481887817383 time for calcul the mask position with numpy : 0.02599644660949707 nb_pixel_total : 514040 time to create 1 rle with new method : 0.8893618583679199 time for calcul the mask position with numpy : 0.02341485023498535 nb_pixel_total : 44744 time to create 1 rle with old method : 0.047827959060668945 time for calcul the mask position with numpy : 0.021189212799072266 nb_pixel_total : 28594 time to create 1 rle with old method : 0.030672550201416016 time for calcul the mask position with numpy : 0.02272510528564453 nb_pixel_total : 56854 time to create 1 rle with old method : 0.06089019775390625 time for calcul the mask position with numpy : 0.02452707290649414 nb_pixel_total : 277291 time to create 1 rle with new method : 0.5711896419525146 time for calcul the mask position with numpy : 0.0201876163482666 nb_pixel_total : 8227 time to create 1 rle with old method : 0.00867462158203125 time for calcul the mask position with numpy : 0.020697355270385742 nb_pixel_total : 23145 time to create 1 rle with old method : 0.025126934051513672 time for calcul the mask position with numpy : 0.022347211837768555 nb_pixel_total : 18400 time to create 1 rle with old method : 0.019591569900512695 time for calcul the mask position with numpy : 0.022099018096923828 nb_pixel_total : 12249 time to create 1 rle with old method : 0.013300418853759766 time for calcul the mask position with numpy : 0.023837804794311523 nb_pixel_total : 156675 time to create 1 rle with new method : 0.7148282527923584 time for calcul the mask position with numpy : 0.020425796508789062 nb_pixel_total : 51475 time to create 1 rle with old method : 0.05520319938659668 time for calcul the mask position with numpy : 0.0337522029876709 nb_pixel_total : 8731 time to create 1 rle with old method : 0.014578104019165039 create new chi : 3.854950428009033 time to delete rle : 0.002643585205078125 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 12493 TO DO : save crop sub photo not yet done ! save time : 0.7617089748382568 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 8.469103574752808 time for calcul the mask position with numpy : 0.6273293495178223 nb_pixel_total : 5815965 time to create 1 rle with new method : 0.8703155517578125 time for calcul the mask position with numpy : 0.03514552116394043 nb_pixel_total : 64860 time to create 1 rle with old method : 0.07048153877258301 time for calcul the mask position with numpy : 0.023133516311645508 nb_pixel_total : 209233 time to create 1 rle with new method : 0.624330997467041 time for calcul the mask position with numpy : 0.020732879638671875 nb_pixel_total : 1598 time to create 1 rle with old method : 0.0018470287322998047 time for calcul the mask position with numpy : 0.020549535751342773 nb_pixel_total : 21307 time to create 1 rle with old method : 0.027719497680664062 time for calcul the mask position with numpy : 0.020968914031982422 nb_pixel_total : 11913 time to create 1 rle with old method : 0.012886285781860352 time for calcul the mask position with numpy : 0.021387815475463867 nb_pixel_total : 26604 time to create 1 rle with old method : 0.029722213745117188 time for calcul the mask position with numpy : 0.024253368377685547 nb_pixel_total : 72890 time to create 1 rle with old method : 0.08875346183776855 time for calcul the mask position with numpy : 0.022161483764648438 nb_pixel_total : 12281 time to create 1 rle with old method : 0.014155149459838867 time for calcul the mask position with numpy : 0.02503204345703125 nb_pixel_total : 43069 time to create 1 rle with old method : 0.04763174057006836 time for calcul the mask position with numpy : 0.02185797691345215 nb_pixel_total : 55618 time to create 1 rle with old method : 0.060839176177978516 time for calcul the mask position with numpy : 0.022621631622314453 nb_pixel_total : 104766 time to create 1 rle with old method : 0.11779975891113281 time for calcul the mask position with numpy : 0.033881425857543945 nb_pixel_total : 46979 time to create 1 rle with old method : 0.051232337951660156 time for calcul the mask position with numpy : 0.03463625907897949 nb_pixel_total : 8101 time to create 1 rle with old method : 0.008849859237670898 time for calcul the mask position with numpy : 0.03593587875366211 nb_pixel_total : 25485 time to create 1 rle with old method : 0.02793121337890625 time for calcul the mask position with numpy : 0.03471946716308594 nb_pixel_total : 26463 time to create 1 rle with old method : 0.032775163650512695 time for calcul the mask position with numpy : 0.03382277488708496 nb_pixel_total : 8849 time to create 1 rle with old method : 0.009984016418457031 time for calcul the mask position with numpy : 0.03423810005187988 nb_pixel_total : 51538 time to create 1 rle with old method : 0.05562734603881836 time for calcul the mask position with numpy : 0.03331184387207031 nb_pixel_total : 33617 time to create 1 rle with old method : 0.03693079948425293 time for calcul the mask position with numpy : 0.039113759994506836 nb_pixel_total : 118995 time to create 1 rle with old method : 0.12778806686401367 time for calcul the mask position with numpy : 0.032271623611450195 nb_pixel_total : 14841 time to create 1 rle with old method : 0.01571941375732422 time for calcul the mask position with numpy : 0.03436923027038574 nb_pixel_total : 67369 time to create 1 rle with old method : 0.0710897445678711 time for calcul the mask position with numpy : 0.03407573699951172 nb_pixel_total : 207899 time to create 1 rle with new method : 0.6047921180725098 create new chi : 4.3585546016693115 time to delete rle : 0.004110097885131836 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 14293 TO DO : save crop sub photo not yet done ! save time : 0.9264156818389893 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.2101898193359375 time for calcul the mask position with numpy : 0.58821702003479 nb_pixel_total : 6553090 time to create 1 rle with new method : 0.6803383827209473 time for calcul the mask position with numpy : 0.021650075912475586 nb_pixel_total : 59062 time to create 1 rle with old method : 0.06548333168029785 time for calcul the mask position with numpy : 0.021965742111206055 nb_pixel_total : 13058 time to create 1 rle with old method : 0.014205694198608398 time for calcul the mask position with numpy : 0.021567106246948242 nb_pixel_total : 21807 time to create 1 rle with old method : 0.023642301559448242 time for calcul the mask position with numpy : 0.035073041915893555 nb_pixel_total : 132025 time to create 1 rle with old method : 0.14099788665771484 time for calcul the mask position with numpy : 0.032961130142211914 nb_pixel_total : 16438 time to create 1 rle with old method : 0.017577409744262695 time for calcul the mask position with numpy : 0.033156394958496094 nb_pixel_total : 61142 time to create 1 rle with old method : 0.06633877754211426 time for calcul the mask position with numpy : 0.03347349166870117 nb_pixel_total : 13657 time to create 1 rle with old method : 0.014715433120727539 time for calcul the mask position with numpy : 0.0346527099609375 nb_pixel_total : 13164 time to create 1 rle with old method : 0.02814173698425293 time for calcul the mask position with numpy : 0.038689613342285156 nb_pixel_total : 17172 time to create 1 rle with old method : 0.023116111755371094 time for calcul the mask position with numpy : 0.03374981880187988 nb_pixel_total : 11661 time to create 1 rle with old method : 0.012696981430053711 time for calcul the mask position with numpy : 0.03238868713378906 nb_pixel_total : 4673 time to create 1 rle with old method : 0.005151987075805664 time for calcul the mask position with numpy : 0.020670413970947266 nb_pixel_total : 24732 time to create 1 rle with old method : 0.02663254737854004 time for calcul the mask position with numpy : 0.020662546157836914 nb_pixel_total : 42603 time to create 1 rle with old method : 0.04569697380065918 time for calcul the mask position with numpy : 0.02044081687927246 nb_pixel_total : 32123 time to create 1 rle with old method : 0.03451991081237793 time for calcul the mask position with numpy : 0.02151966094970703 nb_pixel_total : 10409 time to create 1 rle with old method : 0.011154890060424805 time for calcul the mask position with numpy : 0.02112579345703125 nb_pixel_total : 23424 time to create 1 rle with old method : 0.025381803512573242 create new chi : 2.3062872886657715 time to delete rle : 0.001562356948852539 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9160 TO DO : save crop sub photo not yet done ! save time : 0.6440179347991943 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 3.957024574279785 time for calcul the mask position with numpy : 0.7444915771484375 nb_pixel_total : 6586387 time to create 1 rle with new method : 1.0552339553833008 time for calcul the mask position with numpy : 0.021010160446166992 nb_pixel_total : 42742 time to create 1 rle with old method : 0.046132564544677734 time for calcul the mask position with numpy : 0.020625829696655273 nb_pixel_total : 40132 time to create 1 rle with old method : 0.0466456413269043 time for calcul the mask position with numpy : 0.023247480392456055 nb_pixel_total : 58639 time to create 1 rle with old method : 0.06545209884643555 time for calcul the mask position with numpy : 0.02526569366455078 nb_pixel_total : 17105 time to create 1 rle with old method : 0.01914691925048828 time for calcul the mask position with numpy : 0.020805835723876953 nb_pixel_total : 27487 time to create 1 rle with old method : 0.030366182327270508 time for calcul the mask position with numpy : 0.021204710006713867 nb_pixel_total : 18477 time to create 1 rle with old method : 0.019491910934448242 time for calcul the mask position with numpy : 0.021580934524536133 nb_pixel_total : 18295 time to create 1 rle with old method : 0.019867420196533203 time for calcul the mask position with numpy : 0.021735191345214844 nb_pixel_total : 50881 time to create 1 rle with old method : 0.05500960350036621 time for calcul the mask position with numpy : 0.022454023361206055 nb_pixel_total : 25763 time to create 1 rle with old method : 0.028723478317260742 time for calcul the mask position with numpy : 0.03540825843811035 nb_pixel_total : 59187 time to create 1 rle with old method : 0.0655519962310791 time for calcul the mask position with numpy : 0.037320613861083984 nb_pixel_total : 105145 time to create 1 rle with old method : 0.11274480819702148 create new chi : 2.617560863494873 time to delete rle : 0.0013573169708251953 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8270 TO DO : save crop sub photo not yet done ! save time : 0.5343804359436035 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.7077250480651855 time for calcul the mask position with numpy : 0.4938676357269287 nb_pixel_total : 6851444 time to create 1 rle with new method : 0.6945946216583252 time for calcul the mask position with numpy : 0.03808164596557617 nb_pixel_total : 5209 time to create 1 rle with old method : 0.012976408004760742 time for calcul the mask position with numpy : 0.046060800552368164 nb_pixel_total : 4655 time to create 1 rle with old method : 0.0059816837310791016 time for calcul the mask position with numpy : 0.027863740921020508 nb_pixel_total : 17893 time to create 1 rle with old method : 0.02372288703918457 time for calcul the mask position with numpy : 0.02623128890991211 nb_pixel_total : 20044 time to create 1 rle with old method : 0.027095556259155273 time for calcul the mask position with numpy : 0.0262601375579834 nb_pixel_total : 34432 time to create 1 rle with old method : 0.04512596130371094 time for calcul the mask position with numpy : 0.02718496322631836 nb_pixel_total : 37297 time to create 1 rle with old method : 0.043183088302612305 time for calcul the mask position with numpy : 0.030122995376586914 nb_pixel_total : 16163 time to create 1 rle with old method : 0.017133712768554688 time for calcul the mask position with numpy : 0.03344893455505371 nb_pixel_total : 14004 time to create 1 rle with old method : 0.014929533004760742 time for calcul the mask position with numpy : 0.034598588943481445 nb_pixel_total : 30317 time to create 1 rle with old method : 0.05035853385925293 time for calcul the mask position with numpy : 0.03803563117980957 nb_pixel_total : 18782 time to create 1 rle with old method : 0.020853519439697266 create new chi : 1.8195412158966064 time to delete rle : 0.0009319782257080078 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 5206 TO DO : save crop sub photo not yet done ! save time : 0.36481738090515137 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 7.17071795463562 time for calcul the mask position with numpy : 0.4231245517730713 nb_pixel_total : 6372078 time to create 1 rle with new method : 0.680966854095459 time for calcul the mask position with numpy : 0.020625829696655273 nb_pixel_total : 35249 time to create 1 rle with old method : 0.037653207778930664 time for calcul the mask position with numpy : 0.02186727523803711 nb_pixel_total : 40216 time to create 1 rle with old method : 0.04321479797363281 time for calcul the mask position with numpy : 0.02049708366394043 nb_pixel_total : 28680 time to create 1 rle with old method : 0.029459476470947266 time for calcul the mask position with numpy : 0.0283815860748291 nb_pixel_total : 26510 time to create 1 rle with old method : 0.0278017520904541 time for calcul the mask position with numpy : 0.032082319259643555 nb_pixel_total : 24642 time to create 1 rle with old method : 0.02563929557800293 time for calcul the mask position with numpy : 0.03300738334655762 nb_pixel_total : 19390 time to create 1 rle with old method : 0.02141094207763672 time for calcul the mask position with numpy : 0.034154653549194336 nb_pixel_total : 21248 time to create 1 rle with old method : 0.023363590240478516 time for calcul the mask position with numpy : 0.034247636795043945 nb_pixel_total : 12771 time to create 1 rle with old method : 0.014167070388793945 time for calcul the mask position with numpy : 0.03495383262634277 nb_pixel_total : 9474 time to create 1 rle with old method : 0.010267972946166992 time for calcul the mask position with numpy : 0.03603625297546387 nb_pixel_total : 116583 time to create 1 rle with old method : 0.12472105026245117 time for calcul the mask position with numpy : 0.03388381004333496 nb_pixel_total : 48272 time to create 1 rle with old method : 0.05247664451599121 time for calcul the mask position with numpy : 0.03469085693359375 nb_pixel_total : 33435 time to create 1 rle with old method : 0.03669929504394531 time for calcul the mask position with numpy : 0.020420074462890625 nb_pixel_total : 23720 time to create 1 rle with old method : 0.025776147842407227 time for calcul the mask position with numpy : 0.022045612335205078 nb_pixel_total : 17499 time to create 1 rle with old method : 0.019549131393432617 time for calcul the mask position with numpy : 0.020691394805908203 nb_pixel_total : 31819 time to create 1 rle with old method : 0.03789329528808594 time for calcul the mask position with numpy : 0.020809650421142578 nb_pixel_total : 7556 time to create 1 rle with old method : 0.007988691329956055 time for calcul the mask position with numpy : 0.020978689193725586 nb_pixel_total : 162492 time to create 1 rle with new method : 0.66188645362854 time for calcul the mask position with numpy : 0.021748781204223633 nb_pixel_total : 18606 time to create 1 rle with old method : 0.020703554153442383 create new chi : 2.87678599357605 time to delete rle : 0.00162506103515625 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 9885 TO DO : save crop sub photo not yet done ! save time : 0.6291296482086182 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 3.799370288848877 time for calcul the mask position with numpy : 0.7531375885009766 nb_pixel_total : 6375143 time to create 1 rle with new method : 0.7116570472717285 time for calcul the mask position with numpy : 0.020664215087890625 nb_pixel_total : 35835 time to create 1 rle with old method : 0.03829479217529297 time for calcul the mask position with numpy : 0.021728038787841797 nb_pixel_total : 77150 time to create 1 rle with old method : 0.08629059791564941 time for calcul the mask position with numpy : 0.022150754928588867 nb_pixel_total : 92142 time to create 1 rle with old method : 0.09964251518249512 time for calcul the mask position with numpy : 0.021639585494995117 nb_pixel_total : 20797 time to create 1 rle with old method : 0.022011518478393555 time for calcul the mask position with numpy : 0.020531654357910156 nb_pixel_total : 61197 time to create 1 rle with old method : 0.0649251937866211 time for calcul the mask position with numpy : 0.022444725036621094 nb_pixel_total : 221248 time to create 1 rle with new method : 0.6378176212310791 time for calcul the mask position with numpy : 0.020058155059814453 nb_pixel_total : 3563 time to create 1 rle with old method : 0.003793954849243164 time for calcul the mask position with numpy : 0.02055215835571289 nb_pixel_total : 46853 time to create 1 rle with old method : 0.05055046081542969 time for calcul the mask position with numpy : 0.021375417709350586 nb_pixel_total : 24039 time to create 1 rle with old method : 0.026348114013671875 time for calcul the mask position with numpy : 0.021153926849365234 nb_pixel_total : 70767 time to create 1 rle with old method : 0.07674670219421387 time for calcul the mask position with numpy : 0.020506620407104492 nb_pixel_total : 21506 time to create 1 rle with old method : 0.022289276123046875 create new chi : 2.8885936737060547 time to delete rle : 0.0020558834075927734 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8863 TO DO : save crop sub photo not yet done ! save time : 0.5677831172943115 map_output_result : {1360104982: (0.0, 'Should be the crop_list due to order', 0), 1360100792: (0.0, 'Should be the crop_list due to order', 0), 1360100720: (0.0, 'Should be the crop_list due to order', 0), 1360100633: (0.0, 'Should be the crop_list due to order', 0), 1360099747: (0.0, 'Should be the crop_list due to order', 0), 1360099063: (0.0, 'Should be the crop_list due to order', 0), 1360098939: (0.0, 'Should be the crop_list due to order', 0), 1360098867: (0.0, 'Should be the crop_list due to order', 0), 1360098810: (0.0, 'Should be the crop_list due to order', 0), 1360098710: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360104982, 1360100792, 1360100720, 1360100633, 1360099747, 1360099063, 1360098939, 1360098867, 1360098810, 1360098710] Looping around the photos to save general results len do output : 10 /1360104982.Didn't retrieve data . /1360100792.Didn't retrieve data . /1360100720.Didn't retrieve data . /1360100633.Didn't retrieve data . /1360099747.Didn't retrieve data . /1360099063.Didn't retrieve data . /1360098939.Didn't retrieve data . /1360098867.Didn't retrieve data . /1360098810.Didn't retrieve data . /1360098710.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360104982', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100792', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100720', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100633', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099747', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099063', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098939', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098867', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098810', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098710', None, None, None, None, None, '2928625') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.0146331787109375 save_final save missing photos in datou_result : time spend for datou_step_exec : 94.07439184188843 time spend to save output : 0.015131235122680664 total time spend for step 3 : 94.08952307701111 step4:ventilate_hashtags_in_portfolio Wed May 21 19:54:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23223954 get user id for portfolio 23223954 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23223954 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','metal','autre','pet_fonce','environnement','mal_croppe','pet_clair','flou','background','papier','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23223954 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','metal','autre','pet_fonce','environnement','mal_croppe','pet_clair','flou','background','papier','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23223954 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','metal','autre','pet_fonce','environnement','mal_croppe','pet_clair','flou','background','papier','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23225048,23225049,23225050,23225051,23225052,23225053,23225054,23225055,23225056,23225057,23225058?tags=carton,metal,autre,pet_fonce,environnement,mal_croppe,pet_clair,flou,background,papier,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360104982, 1360100792, 1360100720, 1360100633, 1360099747, 1360099063, 1360098939, 1360098867, 1360098810, 1360098710] Looping around the photos to save general results len do output : 1 /23223954. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360104982', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100792', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100720', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100633', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099747', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099063', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098939', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098867', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098810', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098710', None, None, None, None, None, '2928625') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013630390167236328 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.530071496963501 time spend to save output : 0.01394033432006836 total time spend for step 4 : 1.5440118312835693 step5:final Wed May 21 19:54:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360104982: ('0.1368348169707698',), 1360100792: ('0.1368348169707698',), 1360100720: ('0.1368348169707698',), 1360100633: ('0.1368348169707698',), 1360099747: ('0.1368348169707698',), 1360099063: ('0.1368348169707698',), 1360098939: ('0.1368348169707698',), 1360098867: ('0.1368348169707698',), 1360098810: ('0.1368348169707698',), 1360098710: ('0.1368348169707698',)} new output for save of step final : {1360104982: ('0.1368348169707698',), 1360100792: ('0.1368348169707698',), 1360100720: ('0.1368348169707698',), 1360100633: ('0.1368348169707698',), 1360099747: ('0.1368348169707698',), 1360099063: ('0.1368348169707698',), 1360098939: ('0.1368348169707698',), 1360098867: ('0.1368348169707698',), 1360098810: ('0.1368348169707698',), 1360098710: ('0.1368348169707698',)} [1360104982, 1360100792, 1360100720, 1360100633, 1360099747, 1360099063, 1360098939, 1360098867, 1360098810, 1360098710] Looping around the photos to save general results len do output : 10 /1360104982.Didn't retrieve data . /1360100792.Didn't retrieve data . /1360100720.Didn't retrieve data . /1360100633.Didn't retrieve data . /1360099747.Didn't retrieve data . /1360099063.Didn't retrieve data . /1360098939.Didn't retrieve data . /1360098867.Didn't retrieve data . /1360098810.Didn't retrieve data . /1360098710.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360104982', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100792', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100720', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100633', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099747', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099063', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098939', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098867', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098810', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098710', None, None, None, None, None, '2928625') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013576269149780273 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10903024673461914 time spend to save output : 0.014053821563720703 total time spend for step 5 : 0.12308406829833984 step6:blur_detection Wed May 21 19:54:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a.jpg resize: (2160, 3264) 1360104982 -2.324568054989112 treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c.jpg resize: (2160, 3264) 1360100792 2.4007104518166336 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2.jpg resize: (2160, 3264) 1360100720 -1.9194879006947232 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23.jpg resize: (2160, 3264) 1360100633 -2.076036419366048 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a.jpg resize: (2160, 3264) 1360099747 -0.5940868548718558 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6.jpg resize: (2160, 3264) 1360099063 -2.0330367323419822 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168.jpg resize: (2160, 3264) 1360098939 -2.282308726736219 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f.jpg resize: (2160, 3264) 1360098867 -1.0995997533983644 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc.jpg resize: (2160, 3264) 1360098810 -1.3035737231401772 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f.jpg resize: (2160, 3264) 1360098710 -1.475008782520308 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152444_0.png resize: (153, 138) 1360137722 -1.3324563913746317 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152445_0.png resize: (245, 159) 1360137723 -1.5964198138767858 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152446_0.png resize: (225, 179) 1360137724 -1.550434325652045 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152447_0.png resize: (93, 141) 1360137725 -0.9970925972728338 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152449_0.png resize: (138, 154) 1360137726 -1.653644902533827 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152454_0.png resize: (135, 161) 1360137727 -1.2075085314364844 treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152455_0.png resize: (1068, 1112) 1360137728 1.3340405244350761 treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152456_0.png resize: (716, 1167) 1360137729 1.576175433442651 treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152457_0.png resize: (481, 617) 1360137730 -0.2370795789961848 treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152460_0.png resize: (760, 646) 1360137731 -0.055715324371334106 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152464_0.png resize: (256, 240) 1360137732 -1.2969624318660016 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152469_0.png resize: (271, 295) 1360137733 -1.4470144007480663 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152472_0.png resize: (278, 186) 1360137734 -2.282512755611858 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152474_0.png resize: (121, 109) 1360137735 0.9324424959625133 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152475_0.png resize: (312, 306) 1360137736 -1.2602027514688638 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152476_0.png resize: (520, 633) 1360137737 -1.4420418860212376 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152477_0.png resize: (232, 149) 1360137738 -1.178240993138697 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152483_0.png resize: (475, 177) 1360137739 -2.5299256434929376 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152485_0.png resize: (1173, 963) 1360137740 -1.850504990715639 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152488_0.png resize: (662, 600) 1360137741 -0.6282983295913247 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152490_0.png resize: (278, 79) 1360137742 -1.745518669909342 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152491_0.png resize: (380, 464) 1360137743 -1.1653035895611235 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152494_0.png resize: (110, 113) 1360137744 -0.21082412515040447 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152495_0.png resize: (370, 126) 1360137745 -2.3987961055795775 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152496_0.png resize: (139, 255) 1360137746 -0.9116006364312775 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152497_0.png resize: (85, 141) 1360137747 -0.8379042945657327 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152500_0.png resize: (356, 362) 1360137748 -0.13238693543416835 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152501_0.png resize: (314, 335) 1360137749 -1.9299042760510965 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152502_0.png resize: (129, 129) 1360137750 0.823137726248323 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152504_0.png resize: (166, 220) 1360137751 -0.9518961789611894 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152505_0.png resize: (137, 134) 1360137752 -0.4726512814913815 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152506_0.png resize: (108, 313) 1360137753 -2.4183745520271946 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152507_0.png resize: (119, 130) 1360137754 -0.6358887537101627 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152510_0.png resize: (294, 137) 1360137755 -1.1811309286319371 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152512_0.png resize: (238, 183) 1360137756 -1.034657326130917 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152513_0.png resize: (232, 252) 1360137757 -0.9782135611064552 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152515_0.png resize: (78, 89) 1360137758 -0.9081492962958048 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152518_0.png resize: (95, 190) 1360137759 -1.4358579258715916 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152520_0.png resize: (318, 262) 1360137760 -0.9894439237433084 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152521_0.png resize: (233, 89) 1360137761 -0.9473176436361752 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152524_0.png resize: (141, 119) 1360137762 -0.16412209381391515 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152525_0.png resize: (278, 386) 1360137763 -1.2491963659197791 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152527_0.png resize: (303, 317) 1360137765 -1.3584650586644433 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152530_0.png resize: (154, 151) 1360137766 -1.017477179126975 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152531_0.png resize: (157, 183) 1360137767 -1.5387891078603328 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152537_0.png resize: (162, 176) 1360137768 -0.27425871446397787 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152538_0.png resize: (251, 178) 1360137769 -0.22928261393049434 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152539_0.png resize: (123, 175) 1360137770 -1.1743597152452188 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152540_0.png resize: (155, 138) 1360137771 -1.0023951874863668 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152542_0.png resize: (239, 213) 1360137772 -0.6352478797027582 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152544_0.png resize: (117, 192) 1360137773 -0.04889444894792423 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152545_0.png resize: (76, 73) 1360137774 4.620995601899968 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152546_0.png resize: (78, 99) 1360137775 1.1096677435114848 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152547_0.png resize: (225, 127) 1360137776 -0.8788102019232512 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152549_0.png resize: (98, 108) 1360137777 -1.2886829788605123 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152551_0.png resize: (131, 192) 1360137778 0.6013704142529797 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152553_0.png resize: (140, 355) 1360137779 -1.7081620677712614 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152554_0.png resize: (323, 255) 1360137780 -1.126148555361222 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152556_0.png resize: (116, 104) 1360137781 0.9260610613106269 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152557_0.png resize: (105, 173) 1360137782 -1.1733268764600868 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152559_0.png resize: (229, 169) 1360137783 -2.5460086578536902 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152561_0.png resize: (190, 190) 1360137784 -1.4893595993867215 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152563_0.png resize: (167, 361) 1360137785 -1.440381116451047 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152565_0.png resize: (187, 186) 1360137787 -0.6339264123113907 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152567_0.png resize: (171, 236) 1360137788 -0.5762651026139479 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152569_0.png resize: (88, 148) 1360137789 0.5743018595268427 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152570_0.png resize: (523, 543) 1360137791 -0.9424806169016255 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152571_0.png resize: (305, 393) 1360137792 -1.97207567449383 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152572_0.png resize: (235, 223) 1360137793 -0.8896373068181235 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152573_0.png resize: (521, 326) 1360137795 -1.2425092434103064 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152574_0.png resize: (346, 383) 1360137796 -1.8178779432423082 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152450_0.png resize: (317, 243) 1360137881 -0.47667224635583033 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152467_0.png resize: (963, 741) 1360137882 -0.8120601453976128 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152471_0.png resize: (175, 337) 1360137884 -2.3953004887531444 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152478_0.png resize: (178, 145) 1360137885 0.10000976701646952 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152482_0.png resize: (209, 401) 1360137886 -2.2704766082630905 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152486_0.png resize: (115, 158) 1360137888 -2.246314397534795 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152508_0.png resize: (468, 734) 1360137890 -0.889255474235747 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152509_0.png resize: (265, 406) 1360137891 -1.294560917899495 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152511_0.png resize: (127, 93) 1360137892 1.6990009537063981 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152514_0.png resize: (202, 167) 1360137894 -0.6640987167087009 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152516_0.png resize: (156, 116) 1360137895 -1.7107592476225655 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152517_0.png resize: (197, 171) 1360137896 -1.2454476245073345 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152523_0.png resize: (194, 179) 1360137898 -1.9626134926966146 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152528_0.png resize: (231, 182) 1360137899 0.2375593406538328 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152529_0.png resize: (373, 220) 1360137900 -1.5671166876553024 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152532_0.png resize: (266, 140) 1360137902 -1.1247528723351554 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152533_0.png resize: (202, 128) 1360137903 -1.9459004038788 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152535_0.png resize: (232, 199) 1360137904 0.007430407189477584 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152543_0.png resize: (127, 192) 1360137906 0.80617327456229 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152550_0.png resize: (202, 280) 1360137908 -0.8072014611747744 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152552_0.png resize: (157, 197) 1360137909 0.02606660568009806 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152452_0.png resize: (89, 103) 1360137924 -0.24934385141870163 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152448_0.png resize: (157, 187) 1360138105 -2.2147353775895975 treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152458_0.png resize: (397, 761) 1360138108 0.10171693944658211 treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152459_0.png resize: (743, 898) 1360138109 -1.051456302311972 treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152461_0.png resize: (659, 276) 1360138110 -1.1454864433198966 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152462_0.png resize: (127, 627) 1360138113 -1.527288066184647 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152463_0.png resize: (272, 218) 1360138114 -1.034922736775988 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152465_0.png resize: (409, 599) 1360138115 -0.6670716714101624 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152468_0.png resize: (306, 872) 1360138118 -0.1446567161305094 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152470_0.png resize: (110, 291) 1360138119 -2.4771557963110125 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152473_0.png resize: (412, 376) 1360138121 -0.7433760955149965 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152479_0.png resize: (160, 190) 1360138124 -2.5511423933313595 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152480_0.png resize: (87, 126) 1360138125 -2.4448597893146364 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152481_0.png resize: (597, 618) 1360138126 -1.5575903828352888 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152484_0.png resize: (251, 306) 1360138129 -1.6340205434852497 treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152487_0.png resize: (98, 189) 1360138130 -3.6068764507862374 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152489_0.png resize: (326, 312) 1360138131 -2.076152794509335 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152492_0.png resize: (238, 229) 1360138134 -2.757549671052289 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152493_0.png resize: (261, 268) 1360138135 -3.693101151869897 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152498_0.png resize: (225, 326) 1360138136 -0.8978718548406395 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152499_0.png resize: (324, 411) 1360138138 -0.9931312751906247 treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152503_0.png resize: (213, 429) 1360138140 0.48959095018293686 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152519_0.png resize: (136, 165) 1360138141 -3.2777812391121772 treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152522_0.png resize: (445, 381) 1360138142 -1.699338097698043 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152526_0.png resize: (426, 293) 1360138145 -1.6386451617421214 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152534_0.png resize: (268, 299) 1360138146 -1.4231232962572555 treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152536_0.png resize: (251, 252) 1360138147 -1.6610232601387291 treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152541_0.png resize: (173, 306) 1360138150 -2.8422686820475427 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152548_0.png resize: (415, 465) 1360138151 -1.7670912968428196 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152555_0.png resize: (310, 488) 1360138152 -2.503165881601948 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152558_0.png resize: (131, 206) 1360138155 -0.5205236597823606 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152560_0.png resize: (191, 192) 1360138156 -0.6123320339987149 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152562_0.png resize: (206, 247) 1360138158 -1.1541168147405707 treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152564_0.png resize: (173, 327) 1360138161 -1.2068780215623178 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152566_0.png resize: (239, 389) 1360138162 -0.6427292630933626 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152568_0.png resize: (155, 396) 1360138163 -3.7768956220043273 treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152575_0.png resize: (211, 231) 1360138166 -1.536989596518676 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152451_0.png resize: (115, 166) 1360138220 -0.866170263898978 treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152453_0.png resize: (502, 529) 1360138222 -0.49788925660968275 treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152466_0.png resize: (429, 280) 1360138224 -1.1254697448155375 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 142 time used for this insertion : 0.018619775772094727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 142 time used for this insertion : 0.028544187545776367 save missing photos in datou_result : time spend for datou_step_exec : 38.42510104179382 time spend to save output : 0.05220365524291992 total time spend for step 6 : 38.47730469703674 step7:brightness Wed May 21 19:55:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a.jpg treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c.jpg treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2.jpg treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23.jpg treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a.jpg treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6.jpg treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168.jpg treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f.jpg treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc.jpg treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f.jpg treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152444_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152445_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152446_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152447_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152449_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152454_0.png treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152455_0.png treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152456_0.png treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152457_0.png treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152460_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152464_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152469_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152472_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152474_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152475_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152476_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152477_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152483_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152485_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152488_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152490_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152491_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152494_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152495_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152496_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152497_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152500_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152501_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152502_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152504_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152505_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152506_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152507_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152510_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152512_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152513_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152515_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152518_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152520_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152521_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152524_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152525_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152527_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152530_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152531_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152537_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152538_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152539_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152540_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152542_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152544_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152545_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152546_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152547_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152549_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152551_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152553_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152554_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152556_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152557_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152559_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152561_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152563_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152565_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152567_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152569_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152570_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152571_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152572_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152573_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152574_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152450_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152467_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152471_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152478_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152482_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152486_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152508_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152509_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152511_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152514_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152516_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152517_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152523_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152528_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152529_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152532_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152533_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152535_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152543_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152550_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152552_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152452_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152448_0.png treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152458_0.png treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152459_0.png treat image : temp/1747849828_4011197_1360100792_a3e3173a0dd85b2da220b179b6b6918c_rle_crop_3808152461_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152462_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152463_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152465_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152468_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152470_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152473_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152479_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152480_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152481_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152484_0.png treat image : temp/1747849828_4011197_1360100633_db369980409e6975403c105e3e7ada23_rle_crop_3808152487_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152489_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152492_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152493_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152498_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152499_0.png treat image : temp/1747849828_4011197_1360099747_3573adf4aaf3cbd1c87429b5aadc211a_rle_crop_3808152503_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152519_0.png treat image : temp/1747849828_4011197_1360099063_99223c7a626bfe2e67d99f87d1cfebf6_rle_crop_3808152522_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152526_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152534_0.png treat image : temp/1747849828_4011197_1360098939_32e24958f5d194d6d65556c03be70168_rle_crop_3808152536_0.png treat image : temp/1747849828_4011197_1360098867_9cd5bb855f89814f4d2d26e51bf0c09f_rle_crop_3808152541_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152548_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152555_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152558_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152560_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152562_0.png treat image : temp/1747849828_4011197_1360098810_fc48353c0fc81f32840414cd273a52dc_rle_crop_3808152564_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152566_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152568_0.png treat image : temp/1747849828_4011197_1360098710_6a17cc6064d64564496d92a14326522f_rle_crop_3808152575_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152451_0.png treat image : temp/1747849828_4011197_1360104982_21763e98ef1fd7f83e75926e37e3720a_rle_crop_3808152453_0.png treat image : temp/1747849828_4011197_1360100720_f8ddc1e5b2f21a417199aeff88bf45c2_rle_crop_3808152466_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 142 time used for this insertion : 0.018100261688232422 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 142 time used for this insertion : 0.029874086380004883 save missing photos in datou_result : time spend for datou_step_exec : 9.285586833953857 time spend to save output : 0.05271434783935547 total time spend for step 7 : 9.338301181793213 step8:velours_tree Wed May 21 19:55:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1356651782989502 time spend to save output : 4.00543212890625e-05 total time spend for step 8 : 0.13570523262023926 step9:send_mail_cod Wed May 21 19:55:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23223954_21-05-2025_19_55_39.pdf 23225048 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232250481747850139 23225049 change filename to text .imagette232250491747850140 23225050 change filename to text .change filename to text .change filename to text .imagette232250501747850140 23225051 imagette232250511747850141 23225053 imagette232250531747850141 23225054 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232250541747850141 23225055 imagette232250551747850142 23225056 imagette232250561747850142 23225057 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232250571747850142 23225058 imagette232250581747850143 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23223954 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23225048,23225049,23225050,23225051,23225052,23225053,23225054,23225055,23225056,23225057,23225058?tags=carton,metal,autre,pet_fonce,environnement,mal_croppe,pet_clair,flou,background,papier,pehd args[1360104982] : ((1360104982, -2.324568054989112, 492609224), (1360104982, 0.4867709699336858, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360100792] : ((1360100792, 2.4007104518166336, 492688767), (1360100792, 0.3226186274853806, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360100720] : ((1360100720, -1.9194879006947232, 492688767), (1360100720, -0.02867849189128356, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360100633] : ((1360100633, -2.076036419366048, 492609224), (1360100633, 0.23531918187183457, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360099747] : ((1360099747, -0.5940868548718558, 492688767), (1360099747, 0.09136708369398205, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360099063] : ((1360099063, -2.0330367323419822, 492609224), (1360099063, 0.2347919827443078, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360098939] : ((1360098939, -2.282308726736219, 492609224), (1360098939, 0.1126985345906445, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360098867] : ((1360098867, -1.0995997533983644, 492688767), (1360098867, 0.361491426251442, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360098810] : ((1360098810, -1.3035737231401772, 492688767), (1360098810, -0.04059375896742466, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com args[1360098710] : ((1360098710, -1.475008782520308, 492688767), (1360098710, 0.27213996815835984, 2107752395), '0.1368348169707698') We are sending mail with results at report@fotonower.com refus_total : 0.1368348169707698 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23223954 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23223954_21-05-2025_19_55_39.pdf results_Auto_P23223954_21-05-2025_19_55_39.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23223954_21-05-2025_19_55_39.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23223954','results_Auto_P23223954_21-05-2025_19_55_39.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23223954_21-05-2025_19_55_39.pdf','pdf','','0.62','0.1368348169707698') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23223954

https://www.fotonower.com/image?json=false&list_photos_id=1360104982
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360100792
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.4007104518166336)
https://www.fotonower.com/image?json=false&list_photos_id=1360100720
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360100633
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360099747
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360099063
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360098939
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360098867
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360098810
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360098710
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.68%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/23225048?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23225049?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23225050?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23225054?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23225057?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23223954_21-05-2025_19_55_39.pdf.

Lien vers velours :https://www.fotonower.com/velours/23225048,23225049,23225050,23225051,23225052,23225053,23225054,23225055,23225056,23225057,23225058?tags=carton,metal,autre,pet_fonce,environnement,mal_croppe,pet_clair,flou,background,papier,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 21 May 2025 17:55:46 GMT Content-Length: 0 Connection: close X-Message-Id: Uee2zrivSx2S4hYRxyvgLQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360104982, 1360100792, 1360100720, 1360100633, 1360099747, 1360099063, 1360098939, 1360098867, 1360098810, 1360098710] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360104982', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100792', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100720', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100633', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099747', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099063', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098939', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098867', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098810', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098710', None, None, None, None, None, '2928625') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013590335845947266 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.102839231491089 time spend to save output : 0.013786077499389648 total time spend for step 9 : 7.1166253089904785 step10:split_time_score Wed May 21 19:55:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21052025 23223954 Nombre de photos uploadées : 10 / 23040 (0%) 21052025 23223954 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 21052025 23223954 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.00046753883361816406 elapsed_time : insert_dashboard_record_day_entry 0.022480010986328125 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08331856787854033 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219688_21-05-2025_18_56_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219688 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219688 AND mptpi.`type`=3594 To do Qualite : 0.12381409868474136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219689_21-05-2025_19_06_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219689 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219689 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219717 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219758 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219775 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219778 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219791 order by id desc limit 1 Qualite : 0.1417862796160131 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219795_21-05-2025_18_37_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219795 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219795 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219802 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219856 order by id desc limit 1 Qualite : 0.1421742583028582 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219858_21-05-2025_18_30_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219858 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219858 AND mptpi.`type`=3594 To do Qualite : 0.09422273973246707 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219879_21-05-2025_18_18_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219879 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219879 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219881 order by id desc limit 1 Qualite : 0.1368348169707698 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23223954_21-05-2025_19_55_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23223954 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23223954 AND mptpi.`type`=3594 To do Qualite : 0.11925225240559187 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23223969_21-05-2025_19_45_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23223969 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23223969 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23223985 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21052025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360104982, 1360100792, 1360100720, 1360100633, 1360099747, 1360099063, 1360098939, 1360098867, 1360098810, 1360098710] Looping around the photos to save general results len do output : 1 /23223954Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360104982', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100792', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100720', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360100633', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099747', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360099063', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098939', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098867', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098810', None, None, None, None, None, '2928625') ('3318', None, None, None, None, None, None, None, '2928625') ('3318', '23223954', '1360098710', None, None, None, None, None, '2928625') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015142440795898438 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.45913028717041 time spend to save output : 0.015375137329101562 total time spend for step 10 : 9.474505424499512 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 141.53user 130.71system 5:30.54elapsed 82%CPU (0avgtext+0avgdata 5463452maxresident)k 347424inputs+84232outputs (5772major+13547935minor)pagefaults 0swaps