$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTECput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2628013'] with mtr_portfolio_ids : ['20963096'] and first list_photo_ids : [] new path : /proc/709779/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.39697742462158203 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 3 07:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-03 07:20:32.446721: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-03 07:20:32.475304: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-03 07:20:32.477563: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5aec000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-03 07:20:32.477624: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-03 07:20:32.482046: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-03 07:20:32.722229: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1d91c250 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-03 07:20:32.722294: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-03 07:20:32.723860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 07:20:32.724298: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 07:20:32.727761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 07:20:32.731011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 07:20:32.731544: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 07:20:32.734182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 07:20:32.735296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 07:20:32.740096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 07:20:32.741553: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 07:20:32.741633: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 07:20:32.742392: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-03 07:20:32.742407: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-03 07:20:32.742416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-03 07:20:32.744163: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-03 07:20:33.026278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 07:20:33.026358: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 07:20:33.026378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 07:20:33.026397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 07:20:33.026415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 07:20:33.026433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 07:20:33.026451: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 07:20:33.026469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 07:20:33.028064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 07:20:33.029412: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 07:20:33.029465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 07:20:33.029484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 07:20:33.029501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 07:20:33.029519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 07:20:33.029536: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 07:20:33.029553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 07:20:33.029571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 07:20:33.031198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 07:20:33.031234: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-03 07:20:33.031245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-03 07:20:33.031254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-03 07:20:33.032718: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-03 07:20:41.295729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 07:20:41.466243: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.34297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0006732940673828125 length of segment : 24 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0007615089416503906 length of segment : 23 time for calcul the mask position with numpy : 0.0007066726684570312 nb_pixel_total : 47442 time to create 1 rle with old method : 0.06550955772399902 length of segment : 186 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00018644332885742188 length of segment : 14 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1421 time to create 1 rle with old method : 0.0019030570983886719 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -92.77422 max: 147.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00046539306640625 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 72.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -39.84063 max: 148.27187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 74.00000 max: 238.00000 molded_images shape: (1, 640, 640, 3) min: -49.70000 max: 111.99453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -86.20781 max: 149.20156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0007033348083496094 length of segment : 21 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00022602081298828125 length of segment : 9 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 222.00000 molded_images shape: (1, 640, 640, 3) min: -118.63359 max: 115.45156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 160, 3) min: 7.00000 max: 172.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 63.29531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.11406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0005953311920166016 length of segment : 20 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005600452423095703 length of segment : 25 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0004305839538574219 length of segment : 18 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0009212493896484375 length of segment : 53 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 1473 time to create 1 rle with old method : 0.001966714859008789 length of segment : 43 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.0008289813995361328 length of segment : 25 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.00024628639221191406 length of segment : 11 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0016393661499023438 length of segment : 70 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0018589496612548828 length of segment : 45 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 51 time to create 1 rle with old method : 0.00010204315185546875 length of segment : 19 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00014448165893554688 length of segment : 11 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 827 time to create 1 rle with old method : 0.0013785362243652344 length of segment : 35 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0003540515899658203 length of segment : 14 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00022101402282714844 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.02422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00022602081298828125 length of segment : 11 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005831718444824219 length of segment : 24 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005350112915039062 length of segment : 23 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 32 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0009031295776367188 length of segment : 41 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0007348060607910156 length of segment : 28 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.000537872314453125 length of segment : 19 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0006389617919921875 length of segment : 22 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1765 time to create 1 rle with old method : 0.0023114681243896484 length of segment : 43 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005688667297363281 length of segment : 37 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003829002380371094 length of segment : 21 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020241737365722656 length of segment : 16 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0007736682891845703 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -104.73906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2050 time to create 1 rle with old method : 0.002728700637817383 length of segment : 57 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 2538 time to create 1 rle with old method : 0.0033969879150390625 length of segment : 53 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00026702880859375 length of segment : 12 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 450 time to create 1 rle with old method : 0.0006909370422363281 length of segment : 24 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00037360191345214844 length of segment : 21 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006940364837646484 length of segment : 30 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 694 time to create 1 rle with old method : 0.0009157657623291016 length of segment : 56 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0009329319000244141 length of segment : 28 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 2017 time to create 1 rle with old method : 0.0028028488159179688 length of segment : 37 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.00042557716369628906 length of segment : 15 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 2518 time to create 1 rle with old method : 0.0031805038452148438 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.98125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005803108215332031 length of segment : 38 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002467632293701172 length of segment : 17 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0008563995361328125 length of segment : 25 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 599 time to create 1 rle with old method : 0.0008766651153564453 length of segment : 22 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 959 time to create 1 rle with old method : 0.001331329345703125 length of segment : 34 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0007650852203369141 length of segment : 22 time for calcul the mask position with numpy : 0.00014472007751464844 nb_pixel_total : 6499 time to create 1 rle with old method : 0.008348703384399414 length of segment : 113 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.001043558120727539 length of segment : 25 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.0011887550354003906 length of segment : 44 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.0011887550354003906 length of segment : 45 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.95000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005588531494140625 length of segment : 24 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1018 time to create 1 rle with old method : 0.00130462646484375 length of segment : 47 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005745887756347656 length of segment : 23 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0007069110870361328 length of segment : 23 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 2422 time to create 1 rle with old method : 0.0030617713928222656 length of segment : 57 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0015599727630615234 length of segment : 29 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 1444 time to create 1 rle with old method : 0.0025327205657958984 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.51641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00037097930908203125 length of segment : 32 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0010268688201904297 length of segment : 45 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0007040500640869141 length of segment : 26 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0007181167602539062 length of segment : 25 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 209.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 95.17422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0017008781433105469 length of segment : 84 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.16484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1619 time to create 1 rle with old method : 0.002123117446899414 length of segment : 58 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 25 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1402 time to create 1 rle with old method : 0.0018737316131591797 length of segment : 50 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0006194114685058594 length of segment : 15 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0008182525634765625 length of segment : 27 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 581 time to create 1 rle with old method : 0.0011250972747802734 length of segment : 36 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0005099773406982422 length of segment : 14 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0003752708435058594 length of segment : 12 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 18 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.0018143653869628906 length of segment : 44 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0003578662872314453 length of segment : 23 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0003509521484375 length of segment : 19 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.001077413558959961 length of segment : 51 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00040221214294433594 length of segment : 14 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0009233951568603516 length of segment : 25 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0018219947814941406 length of segment : 40 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.00018715858459472656 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.66094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0004391670227050781 length of segment : 21 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004448890686035156 length of segment : 21 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.00028777122497558594 length of segment : 21 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.0010986328125 length of segment : 65 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 927 time to create 1 rle with old method : 0.0012595653533935547 length of segment : 37 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 956 time to create 1 rle with old method : 0.0013036727905273438 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.38359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0005011558532714844 length of segment : 21 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0010499954223632812 length of segment : 19 time for calcul the mask position with numpy : 0.00010132789611816406 nb_pixel_total : 751 time to create 1 rle with old method : 0.0016818046569824219 length of segment : 56 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 1377 time to create 1 rle with old method : 0.003702402114868164 length of segment : 52 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0004210472106933594 length of segment : 18 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00021195411682128906 length of segment : 14 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 373 time to create 1 rle with old method : 0.0009267330169677734 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.18828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005693435668945312 length of segment : 30 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.000316619873046875 length of segment : 15 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.00040435791015625 length of segment : 21 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00037932395935058594 length of segment : 19 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006585121154785156 length of segment : 30 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.000244140625 length of segment : 19 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00035309791564941406 length of segment : 34 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.0004291534423828125 length of segment : 15 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.0002124309539794922 length of segment : 10 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002810955047607422 length of segment : 12 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.0009062290191650391 length of segment : 35 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 51 time to create 1 rle with old method : 0.00010704994201660156 length of segment : 6 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.0004317760467529297 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00034737586975097656 length of segment : 14 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004875659942626953 length of segment : 17 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00021266937255859375 length of segment : 13 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0008957386016845703 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.91094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0011546611785888672 length of segment : 38 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1087 time to create 1 rle with old method : 0.0014715194702148438 length of segment : 36 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00039577484130859375 length of segment : 26 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.0013463497161865234 length of segment : 47 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0008554458618164062 length of segment : 22 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003726482391357422 length of segment : 11 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00035500526428222656 length of segment : 24 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1014 time to create 1 rle with old method : 0.0014562606811523438 length of segment : 35 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0018062591552734375 length of segment : 49 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00043892860412597656 length of segment : 35 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1001 time to create 1 rle with old method : 0.001399993896484375 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.41484 max: 151.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.0002446174621582031 length of segment : 25 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007634162902832031 length of segment : 31 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005147457122802734 length of segment : 29 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0006103515625 length of segment : 20 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 2480 time to create 1 rle with old method : 0.0035140514373779297 length of segment : 52 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1115 time to create 1 rle with old method : 0.001867532730102539 length of segment : 58 Processing 1 images image shape: (400, 160, 3) min: 1.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 76.51016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1937 time to create 1 rle with old method : 0.0038292407989501953 length of segment : 33 time for calcul the mask position with numpy : 0.00022649765014648438 nb_pixel_total : 12450 time to create 1 rle with old method : 0.02377796173095703 length of segment : 143 Processing 1 images image shape: (240, 400, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005755424499511719 length of segment : 19 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0004303455352783203 length of segment : 15 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0012738704681396484 length of segment : 25 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.001210927963256836 length of segment : 28 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003879070281982422 length of segment : 14 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00023603439331054688 length of segment : 10 Processing 1 images image shape: (240, 400, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003399848937988281 length of segment : 20 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0004508495330810547 length of segment : 15 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0004019737243652344 length of segment : 12 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 2377 time to create 1 rle with old method : 0.005244016647338867 length of segment : 41 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0011174678802490234 length of segment : 19 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.00046753883361816406 length of segment : 13 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1039 time to create 1 rle with old method : 0.0014672279357910156 length of segment : 42 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0003223419189453125 length of segment : 13 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 1058 time to create 1 rle with old method : 0.002012014389038086 length of segment : 43 Processing 1 images image shape: (240, 400, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.0014324188232421875 length of segment : 34 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00048089027404785156 length of segment : 21 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.000324249267578125 length of segment : 38 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005860328674316406 length of segment : 21 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003018379211425781 length of segment : 30 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00027632713317871094 length of segment : 21 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 1288 time to create 1 rle with old method : 0.0017735958099365234 length of segment : 33 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 941 time to create 1 rle with old method : 0.0013158321380615234 length of segment : 70 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005776882171630859 length of segment : 20 Processing 1 images image shape: (240, 400, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.36562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0004146099090576172 length of segment : 14 Processing 1 images image shape: (240, 160, 3) min: 10.00000 max: 224.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 119.03808 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0004565715789794922 length of segment : 22 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.65937 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0008304119110107422 length of segment : 25 time for calcul the mask position with numpy : 0.0005812644958496094 nb_pixel_total : 46086 time to create 1 rle with old method : 0.06329464912414551 length of segment : 185 time for calcul the mask position with numpy : 0.00015044212341308594 nb_pixel_total : 1594 time to create 1 rle with old method : 0.004767656326293945 length of segment : 48 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0007989406585693359 length of segment : 25 time for calcul the mask position with numpy : 0.0005688667297363281 nb_pixel_total : 14598 time to create 1 rle with old method : 0.04177093505859375 length of segment : 172 Processing 1 images image shape: (400, 400, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -94.53594 max: 147.56094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1602 time to create 1 rle with old method : 0.002093791961669922 length of segment : 47 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00023627281188964844 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 58.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -43.62969 max: 148.30312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.001064300537109375 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.43438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 0.00011086463928222656 nb_pixel_total : 3617 time to create 1 rle with old method : 0.004462242126464844 length of segment : 92 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1599 time to create 1 rle with old method : 0.002632617950439453 length of segment : 41 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 2322 time to create 1 rle with old method : 0.0030655860900878906 length of segment : 52 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0004515647888183594 length of segment : 15 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00020933151245117188 length of segment : 11 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 3817 time to create 1 rle with old method : 0.0048770904541015625 length of segment : 88 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006737709045410156 length of segment : 25 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1472 time to create 1 rle with old method : 0.0020303726196289062 length of segment : 43 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.00089263916015625 length of segment : 21 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0005419254302978516 length of segment : 21 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1566 time to create 1 rle with old method : 0.0021338462829589844 length of segment : 67 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00025916099548339844 length of segment : 15 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1669 time to create 1 rle with old method : 0.0021028518676757812 length of segment : 68 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0007109642028808594 length of segment : 27 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1710 time to create 1 rle with old method : 0.0021839141845703125 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 240.00000 molded_images shape: (1, 640, 640, 3) min: -96.67266 max: 133.00625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0008039474487304688 length of segment : 16 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.00020885467529296875 length of segment : 9 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 229.00000 molded_images shape: (1, 640, 640, 3) min: -107.98125 max: 115.81875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 160.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 52.73281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 2887 time to create 1 rle with old method : 0.0035157203674316406 length of segment : 72 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.65703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00040721893310546875 length of segment : 27 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004940032958984375 length of segment : 21 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00024247169494628906 length of segment : 11 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1702 time to create 1 rle with old method : 0.002088785171508789 length of segment : 78 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00022721290588378906 length of segment : 14 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00048828125 length of segment : 18 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0006470680236816406 length of segment : 40 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1343 time to create 1 rle with old method : 0.0018243789672851562 length of segment : 40 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00036144256591796875 length of segment : 36 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00031638145446777344 length of segment : 14 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0009958744049072266 length of segment : 52 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0020055770874023438 length of segment : 54 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0007212162017822266 length of segment : 31 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006580352783203125 length of segment : 21 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0003426074981689453 length of segment : 12 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005011558532714844 length of segment : 22 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1748 time to create 1 rle with old method : 0.0023543834686279297 length of segment : 69 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.68438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005919933319091797 length of segment : 24 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006663799285888672 length of segment : 31 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.000530242919921875 length of segment : 21 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004744529724121094 length of segment : 35 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003685951232910156 length of segment : 17 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.001009225845336914 length of segment : 34 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003859996795654297 length of segment : 23 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0006167888641357422 length of segment : 17 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00042319297790527344 length of segment : 28 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006146430969238281 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 882 time to create 1 rle with old method : 0.0011816024780273438 length of segment : 47 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003695487976074219 length of segment : 22 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.00041103363037109375 length of segment : 16 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0004532337188720703 length of segment : 21 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0008988380432128906 length of segment : 34 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 1890 time to create 1 rle with old method : 0.0025310516357421875 length of segment : 67 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0009744167327880859 length of segment : 56 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 855 time to create 1 rle with old method : 0.0011851787567138672 length of segment : 36 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0018372535705566406 length of segment : 41 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0010750293731689453 length of segment : 32 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 25 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0005309581756591797 length of segment : 32 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 1872 time to create 1 rle with old method : 0.0025436878204345703 length of segment : 65 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00028896331787109375 length of segment : 24 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 35 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 614 time to create 1 rle with old method : 0.0008802413940429688 length of segment : 27 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1426 time to create 1 rle with old method : 0.001779317855834961 length of segment : 46 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00027632713317871094 length of segment : 24 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00016021728515625 length of segment : 12 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0009324550628662109 length of segment : 49 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.0010294914245605469 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.28984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 2943 time to create 1 rle with old method : 0.004034996032714844 length of segment : 53 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00036406517028808594 length of segment : 26 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00026154518127441406 length of segment : 17 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003802776336669922 length of segment : 23 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 588 time to create 1 rle with old method : 0.00079345703125 length of segment : 52 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0009760856628417969 length of segment : 41 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005860328674316406 length of segment : 26 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005774497985839844 length of segment : 20 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005800724029541016 length of segment : 34 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00024700164794921875 length of segment : 15 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00018978118896484375 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003681182861328125 length of segment : 24 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006020069122314453 length of segment : 18 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 2775 time to create 1 rle with old method : 0.0035812854766845703 length of segment : 53 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007948875427246094 length of segment : 48 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00020194053649902344 length of segment : 13 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.00019025802612304688 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.79766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006995201110839844 length of segment : 26 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 23 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006351470947265625 length of segment : 34 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006880760192871094 length of segment : 22 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007913112640380859 length of segment : 23 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00025272369384765625 length of segment : 19 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1199 time to create 1 rle with old method : 0.001600027084350586 length of segment : 46 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0005207061767578125 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.50859 max: 150.87344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005617141723632812 length of segment : 25 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006823539733886719 length of segment : 22 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00021004676818847656 length of segment : 28 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00033545494079589844 length of segment : 21 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008337497711181641 length of segment : 37 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 91.49453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1081 time to create 1 rle with old method : 0.0015170574188232422 length of segment : 79 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0008845329284667969 length of segment : 34 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 673 time to create 1 rle with old method : 0.0009660720825195312 length of segment : 32 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003647804260253906 length of segment : 26 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1039 time to create 1 rle with old method : 0.0014057159423828125 length of segment : 38 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0007481575012207031 length of segment : 48 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.00047469139099121094 length of segment : 18 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004420280456542969 length of segment : 30 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.0009543895721435547 length of segment : 38 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.0004425048828125 length of segment : 17 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.0011348724365234375 length of segment : 48 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00039315223693847656 length of segment : 29 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00028014183044433594 length of segment : 12 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0005247592926025391 length of segment : 22 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00027561187744140625 length of segment : 15 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006902217864990234 length of segment : 32 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.00077056884765625 length of segment : 43 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00025963783264160156 length of segment : 16 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0008502006530761719 length of segment : 28 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0007574558258056641 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.29766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 0.00011849403381347656 nb_pixel_total : 823 time to create 1 rle with old method : 0.0011813640594482422 length of segment : 32 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0007147789001464844 length of segment : 23 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1030 time to create 1 rle with old method : 0.0013971328735351562 length of segment : 29 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004782676696777344 length of segment : 58 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 2115 time to create 1 rle with old method : 0.0030508041381835938 length of segment : 45 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0004010200500488281 length of segment : 28 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 984 time to create 1 rle with old method : 0.001344442367553711 length of segment : 66 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 1716 time to create 1 rle with old method : 0.0022192001342773438 length of segment : 91 time for calcul the mask position with numpy : 0.00018286705017089844 nb_pixel_total : 9181 time to create 1 rle with old method : 0.010926008224487305 length of segment : 153 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003795623779296875 length of segment : 29 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005648136138916016 length of segment : 31 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0006127357482910156 length of segment : 36 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 2032 time to create 1 rle with old method : 0.002498626708984375 length of segment : 113 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00016546249389648438 length of segment : 26 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006010532379150391 length of segment : 22 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0017406940460205078 length of segment : 20 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1063 time to create 1 rle with old method : 0.00164794921875 length of segment : 22 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020265579223632812 length of segment : 11 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 68 time to create 1 rle with old method : 0.00012445449829101562 length of segment : 11 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1084 time to create 1 rle with old method : 0.0023641586303710938 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -87.84844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0007784366607666016 length of segment : 21 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007753372192382812 length of segment : 30 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 1489 time to create 1 rle with old method : 0.0028023719787597656 length of segment : 48 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.00043129920959472656 length of segment : 18 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.000583648681640625 length of segment : 23 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0003323554992675781 length of segment : 17 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.00040602684020996094 length of segment : 18 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003185272216796875 length of segment : 18 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0011479854583740234 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.93438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003948211669921875 length of segment : 21 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.00032258033752441406 length of segment : 16 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005962848663330078 length of segment : 32 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004971027374267578 length of segment : 18 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.0008063316345214844 length of segment : 46 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007221698760986328 length of segment : 27 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00023031234741210938 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 16 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004439353942871094 length of segment : 17 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00026535987854003906 length of segment : 17 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002448558807373047 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00044918060302734375 length of segment : 16 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0004038810729980469 length of segment : 16 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003216266632080078 length of segment : 17 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0008385181427001953 length of segment : 32 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00023317337036132812 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.96563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 677 time to create 1 rle with old method : 0.0009028911590576172 length of segment : 38 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0007874965667724609 length of segment : 18 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.00048351287841796875 length of segment : 29 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 1121 time to create 1 rle with old method : 0.0015189647674560547 length of segment : 40 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006749629974365234 length of segment : 31 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003101825714111328 length of segment : 23 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005064010620117188 length of segment : 23 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009779930114746094 length of segment : 29 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00036835670471191406 length of segment : 12 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.00013947486877441406 length of segment : 14 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0009593963623046875 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00040078163146972656 length of segment : 30 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0008180141448974609 length of segment : 28 time for calcul the mask position with numpy : 8.749961853027344e-05 nb_pixel_total : 2027 time to create 1 rle with old method : 0.0037283897399902344 length of segment : 102 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1067 time to create 1 rle with old method : 0.0014145374298095703 length of segment : 54 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0002951622009277344 length of segment : 20 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 184.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 68.85781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 400, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.77187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1918 time to create 1 rle with old method : 0.0027625560760498047 length of segment : 30 time for calcul the mask position with numpy : 0.0005714893341064453 nb_pixel_total : 49252 time to create 1 rle with old method : 0.060066938400268555 length of segment : 217 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1802 time to create 1 rle with old method : 0.0026242733001708984 length of segment : 26 Processing 1 images image shape: (240, 400, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005555152893066406 length of segment : 20 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0004162788391113281 length of segment : 15 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0011684894561767578 length of segment : 28 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002777576446533203 length of segment : 17 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1267 time to create 1 rle with old method : 0.0017917156219482422 length of segment : 31 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005745887756347656 length of segment : 36 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003390312194824219 length of segment : 16 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.0002455711364746094 length of segment : 15 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0009644031524658203 length of segment : 21 Processing 1 images image shape: (240, 400, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00041961669921875 length of segment : 19 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00040602684020996094 length of segment : 15 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 2466 time to create 1 rle with old method : 0.003353595733642578 length of segment : 43 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00044465065002441406 length of segment : 15 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0014505386352539062 length of segment : 42 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1047 time to create 1 rle with old method : 0.0014545917510986328 length of segment : 41 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1098 time to create 1 rle with old method : 0.002049684524536133 length of segment : 42 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1062 time to create 1 rle with old method : 0.001636505126953125 length of segment : 41 Processing 1 images image shape: (240, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 957 time to create 1 rle with old method : 0.0014195442199707031 length of segment : 34 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004546642303466797 length of segment : 19 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.00044655799865722656 length of segment : 33 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002677440643310547 length of segment : 18 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.00035071372985839844 length of segment : 24 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1437 time to create 1 rle with old method : 0.001955747604370117 length of segment : 34 Processing 1 images image shape: (240, 400, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.87344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 160, 3) min: 11.00000 max: 221.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 116.09092 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Detection mask done ! Trying to reset tf kernel 710732 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1748 tf kernel not reseted sub process len(results) : 372 len(list_Values) 372 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 372 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7037 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 372 chid ids of type : 4228 Number RLEs to save : 12176 save missing photos in datou_result : time spend for datou_step_exec : 27.512877464294434 time spend to save output : 1.4073779582977295 total time spend for step 1 : 28.920255422592163 step2:brightness Mon Mar 3 07:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740982829_709779_1340584307_4c5d71d7d1c6c920d3f7f84d169dbf37.jpg treat image : temp/1740982829_709779_1340583079_28b4ec7bebc636efb1207f0cceb32848.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.11589407920837402 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.014348506927490234 save missing photos in datou_result : time spend for datou_step_exec : 1.026304006576538 time spend to save output : 0.13529348373413086 total time spend for step 2 : 1.161597490310669 step3:blur_detection Mon Mar 3 07:20:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740982829_709779_1340584307_4c5d71d7d1c6c920d3f7f84d169dbf37.jpg resize: (1440, 2560) 1340584307 -7.562624003701244 treat image : temp/1740982829_709779_1340583079_28b4ec7bebc636efb1207f0cceb32848.jpg resize: (1440, 2560) 1340583079 -7.541931502321915 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.013378381729125977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.010981321334838867 save missing photos in datou_result : time spend for datou_step_exec : 4.120173215866089 time spend to save output : 0.02977895736694336 total time spend for step 3 : 4.149952173233032 step4:rle_unique_nms_with_priority Mon Mar 3 07:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 372 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 160 nb_hashtags : 5 time to prepare the origin masks : 1.8615522384643555 time for calcul the mask position with numpy : 0.17986679077148438 nb_pixel_total : 3536879 time to create 1 rle with new method : 0.1745469570159912 time for calcul the mask position with numpy : 0.01535940170288086 nb_pixel_total : 46708 time to create 1 rle with old method : 0.061689138412475586 time for calcul the mask position with numpy : 0.017251014709472656 nb_pixel_total : 388 time to create 1 rle with old method : 0.0009315013885498047 time for calcul the mask position with numpy : 0.01718759536743164 nb_pixel_total : 381 time to create 1 rle with old method : 0.0006635189056396484 time for calcul the mask position with numpy : 0.01688361167907715 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004074573516845703 time for calcul the mask position with numpy : 0.015114545822143555 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006470680236816406 time for calcul the mask position with numpy : 0.015111923217773438 nb_pixel_total : 132 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.015107870101928711 nb_pixel_total : 117 time to create 1 rle with old method : 0.00015497207641601562 time for calcul the mask position with numpy : 0.015142679214477539 nb_pixel_total : 827 time to create 1 rle with old method : 0.0010073184967041016 time for calcul the mask position with numpy : 0.015085220336914062 nb_pixel_total : 80 time to create 1 rle with old method : 0.00012683868408203125 time for calcul the mask position with numpy : 0.015114545822143555 nb_pixel_total : 266 time to create 1 rle with old method : 0.00032258033752441406 time for calcul the mask position with numpy : 0.015559196472167969 nb_pixel_total : 143 time to create 1 rle with old method : 0.00022029876708984375 time for calcul the mask position with numpy : 0.015774965286254883 nb_pixel_total : 124 time to create 1 rle with old method : 0.00016736984252929688 time for calcul the mask position with numpy : 0.015201330184936523 nb_pixel_total : 31 time to create 1 rle with old method : 6.628036499023438e-05 time for calcul the mask position with numpy : 0.015121698379516602 nb_pixel_total : 662 time to create 1 rle with old method : 0.0007951259613037109 time for calcul the mask position with numpy : 0.015179872512817383 nb_pixel_total : 356 time to create 1 rle with old method : 0.00043320655822753906 time for calcul the mask position with numpy : 0.015235185623168945 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0015268325805664062 time for calcul the mask position with numpy : 0.015152215957641602 nb_pixel_total : 25 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.015102148056030273 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007288455963134766 time for calcul the mask position with numpy : 0.014992475509643555 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003032684326171875 time for calcul the mask position with numpy : 0.015085220336914062 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004711151123046875 time for calcul the mask position with numpy : 0.015319108963012695 nb_pixel_total : 239 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.015246868133544922 nb_pixel_total : 55 time to create 1 rle with old method : 0.00010991096496582031 time for calcul the mask position with numpy : 0.015345096588134766 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010557174682617188 time for calcul the mask position with numpy : 0.015446662902832031 nb_pixel_total : 6499 time to create 1 rle with old method : 0.007513523101806641 time for calcul the mask position with numpy : 0.01540827751159668 nb_pixel_total : 2538 time to create 1 rle with old method : 0.002958059310913086 time for calcul the mask position with numpy : 0.015339851379394531 nb_pixel_total : 694 time to create 1 rle with old method : 0.0008285045623779297 time for calcul the mask position with numpy : 0.015424728393554688 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0017390251159667969 time for calcul the mask position with numpy : 0.015562772750854492 nb_pixel_total : 41 time to create 1 rle with old method : 0.00011420249938964844 time for calcul the mask position with numpy : 0.01510763168334961 nb_pixel_total : 594 time to create 1 rle with old method : 0.0006918907165527344 time for calcul the mask position with numpy : 0.015531301498413086 nb_pixel_total : 231 time to create 1 rle with old method : 0.00028395652770996094 time for calcul the mask position with numpy : 0.015230178833007812 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002028942108154297 time for calcul the mask position with numpy : 0.01505589485168457 nb_pixel_total : 126 time to create 1 rle with old method : 0.00017380714416503906 time for calcul the mask position with numpy : 0.015150308609008789 nb_pixel_total : 528 time to create 1 rle with old method : 0.0006544589996337891 time for calcul the mask position with numpy : 0.015947580337524414 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003018379211425781 time for calcul the mask position with numpy : 0.015527963638305664 nb_pixel_total : 450 time to create 1 rle with old method : 0.0005495548248291016 time for calcul the mask position with numpy : 0.01618194580078125 nb_pixel_total : 298 time to create 1 rle with old method : 0.0006835460662841797 time for calcul the mask position with numpy : 0.019858837127685547 nb_pixel_total : 408 time to create 1 rle with old method : 0.0007174015045166016 time for calcul the mask position with numpy : 0.01760697364807129 nb_pixel_total : 393 time to create 1 rle with old method : 0.0006630420684814453 time for calcul the mask position with numpy : 0.018165111541748047 nb_pixel_total : 406 time to create 1 rle with old method : 0.0007877349853515625 time for calcul the mask position with numpy : 0.01749873161315918 nb_pixel_total : 724 time to create 1 rle with old method : 0.0012784004211425781 time for calcul the mask position with numpy : 0.01754307746887207 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005674362182617188 time for calcul the mask position with numpy : 0.015454769134521484 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005707740783691406 time for calcul the mask position with numpy : 0.016661882400512695 nb_pixel_total : 35 time to create 1 rle with old method : 0.00019669532775878906 time for calcul the mask position with numpy : 0.018773794174194336 nb_pixel_total : 130 time to create 1 rle with old method : 0.00020742416381835938 time for calcul the mask position with numpy : 0.015810489654541016 nb_pixel_total : 516 time to create 1 rle with old method : 0.0007379055023193359 time for calcul the mask position with numpy : 0.01586437225341797 nb_pixel_total : 661 time to create 1 rle with old method : 0.0008130073547363281 time for calcul the mask position with numpy : 0.01584482192993164 nb_pixel_total : 570 time to create 1 rle with old method : 0.0006961822509765625 time for calcul the mask position with numpy : 0.015688419342041016 nb_pixel_total : 616 time to create 1 rle with old method : 0.0007576942443847656 time for calcul the mask position with numpy : 0.015574216842651367 nb_pixel_total : 2050 time to create 1 rle with old method : 0.0024251937866210938 time for calcul the mask position with numpy : 0.015254497528076172 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005083084106445312 time for calcul the mask position with numpy : 0.015522956848144531 nb_pixel_total : 1444 time to create 1 rle with old method : 0.0017726421356201172 time for calcul the mask position with numpy : 0.015624046325683594 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0014584064483642578 time for calcul the mask position with numpy : 0.01596212387084961 nb_pixel_total : 157 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.015421867370605469 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005292892456054688 time for calcul the mask position with numpy : 0.015083789825439453 nb_pixel_total : 1765 time to create 1 rle with old method : 0.002056598663330078 time for calcul the mask position with numpy : 0.015229940414428711 nb_pixel_total : 314 time to create 1 rle with old method : 0.00037789344787597656 time for calcul the mask position with numpy : 0.014990806579589844 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0016226768493652344 time for calcul the mask position with numpy : 0.015058040618896484 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005693435668945312 time for calcul the mask position with numpy : 0.015078067779541016 nb_pixel_total : 334 time to create 1 rle with old method : 0.00042748451232910156 time for calcul the mask position with numpy : 0.015030145645141602 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005395412445068359 time for calcul the mask position with numpy : 0.015128612518310547 nb_pixel_total : 49 time to create 1 rle with old method : 0.00011301040649414062 time for calcul the mask position with numpy : 0.015174388885498047 nb_pixel_total : 2421 time to create 1 rle with old method : 0.0028078556060791016 time for calcul the mask position with numpy : 0.014952659606933594 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004901885986328125 time for calcul the mask position with numpy : 0.014906167984008789 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0012004375457763672 time for calcul the mask position with numpy : 0.014906167984008789 nb_pixel_total : 599 time to create 1 rle with old method : 0.0007262229919433594 time for calcul the mask position with numpy : 0.014935731887817383 nb_pixel_total : 2017 time to create 1 rle with old method : 0.0023775100708007812 time for calcul the mask position with numpy : 0.01494288444519043 nb_pixel_total : 959 time to create 1 rle with old method : 0.0011286735534667969 time for calcul the mask position with numpy : 0.014941215515136719 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001621246337890625 time for calcul the mask position with numpy : 0.014905214309692383 nb_pixel_total : 316 time to create 1 rle with old method : 0.0003819465637207031 time for calcul the mask position with numpy : 0.014934778213500977 nb_pixel_total : 751 time to create 1 rle with old method : 0.0009138584136962891 time for calcul the mask position with numpy : 0.014912128448486328 nb_pixel_total : 92 time to create 1 rle with old method : 0.00013566017150878906 time for calcul the mask position with numpy : 0.01491856575012207 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.014920711517333984 nb_pixel_total : 267 time to create 1 rle with old method : 0.00031447410583496094 time for calcul the mask position with numpy : 0.014946937561035156 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002720355987548828 time for calcul the mask position with numpy : 0.014908313751220703 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.014898300170898438 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0016143321990966797 time for calcul the mask position with numpy : 0.014956474304199219 nb_pixel_total : 229 time to create 1 rle with old method : 0.00028252601623535156 time for calcul the mask position with numpy : 0.014917850494384766 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004661083221435547 time for calcul the mask position with numpy : 0.014971256256103516 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003294944763183594 time for calcul the mask position with numpy : 0.015684843063354492 nb_pixel_total : 179 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.017533302307128906 nb_pixel_total : 581 time to create 1 rle with old method : 0.0009713172912597656 time for calcul the mask position with numpy : 0.017183303833007812 nb_pixel_total : 557 time to create 1 rle with old method : 0.0009152889251708984 time for calcul the mask position with numpy : 0.01718306541442871 nb_pixel_total : 557 time to create 1 rle with old method : 0.0009434223175048828 time for calcul the mask position with numpy : 0.017295122146606445 nb_pixel_total : 56 time to create 1 rle with old method : 0.0001583099365234375 time for calcul the mask position with numpy : 0.015524625778198242 nb_pixel_total : 241 time to create 1 rle with old method : 0.00031757354736328125 time for calcul the mask position with numpy : 0.015128135681152344 nb_pixel_total : 227 time to create 1 rle with old method : 0.00027441978454589844 time for calcul the mask position with numpy : 0.014935970306396484 nb_pixel_total : 915 time to create 1 rle with old method : 0.0010886192321777344 time for calcul the mask position with numpy : 0.014895439147949219 nb_pixel_total : 692 time to create 1 rle with old method : 0.0008113384246826172 time for calcul the mask position with numpy : 0.014919757843017578 nb_pixel_total : 175 time to create 1 rle with old method : 0.00020933151245117188 time for calcul the mask position with numpy : 0.01491689682006836 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005691051483154297 time for calcul the mask position with numpy : 0.014948606491088867 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005104541778564453 time for calcul the mask position with numpy : 0.014940500259399414 nb_pixel_total : 392 time to create 1 rle with old method : 0.00046515464782714844 time for calcul the mask position with numpy : 0.014915943145751953 nb_pixel_total : 966 time to create 1 rle with old method : 0.0011324882507324219 time for calcul the mask position with numpy : 0.014985322952270508 nb_pixel_total : 161 time to create 1 rle with old method : 0.00019860267639160156 time for calcul the mask position with numpy : 0.014969587326049805 nb_pixel_total : 138 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.01492166519165039 nb_pixel_total : 140 time to create 1 rle with old method : 0.00017380714416503906 time for calcul the mask position with numpy : 0.014894962310791016 nb_pixel_total : 51 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.01495814323425293 nb_pixel_total : 956 time to create 1 rle with old method : 0.00112152099609375 time for calcul the mask position with numpy : 0.014938116073608398 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003154277801513672 time for calcul the mask position with numpy : 0.014945507049560547 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.015044450759887695 nb_pixel_total : 222 time to create 1 rle with old method : 0.00026798248291015625 time for calcul the mask position with numpy : 0.01491093635559082 nb_pixel_total : 994 time to create 1 rle with old method : 0.0011589527130126953 time for calcul the mask position with numpy : 0.01500701904296875 nb_pixel_total : 197 time to create 1 rle with old method : 0.00024628639221191406 time for calcul the mask position with numpy : 0.014970541000366211 nb_pixel_total : 1087 time to create 1 rle with old method : 0.0012354850769042969 time for calcul the mask position with numpy : 0.014994382858276367 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006105899810791016 time for calcul the mask position with numpy : 0.016341209411621094 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003376007080078125 time for calcul the mask position with numpy : 0.014907121658325195 nb_pixel_total : 125 time to create 1 rle with old method : 0.00015544891357421875 time for calcul the mask position with numpy : 0.015007257461547852 nb_pixel_total : 1377 time to create 1 rle with old method : 0.0016489028930664062 time for calcul the mask position with numpy : 0.014906167984008789 nb_pixel_total : 348 time to create 1 rle with old method : 0.00041937828063964844 time for calcul the mask position with numpy : 0.014922618865966797 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005052089691162109 time for calcul the mask position with numpy : 0.016155242919921875 nb_pixel_total : 2480 time to create 1 rle with old method : 0.0028710365295410156 time for calcul the mask position with numpy : 0.014928579330444336 nb_pixel_total : 927 time to create 1 rle with old method : 0.0010797977447509766 time for calcul the mask position with numpy : 0.014920473098754883 nb_pixel_total : 302 time to create 1 rle with old method : 0.00036072731018066406 time for calcul the mask position with numpy : 0.014899253845214844 nb_pixel_total : 72 time to create 1 rle with old method : 9.131431579589844e-05 time for calcul the mask position with numpy : 0.014856338500976562 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005867481231689453 time for calcul the mask position with numpy : 0.014824628829956055 nb_pixel_total : 1402 time to create 1 rle with old method : 0.0016226768493652344 time for calcul the mask position with numpy : 0.014926910400390625 nb_pixel_total : 312 time to create 1 rle with old method : 0.00036454200744628906 time for calcul the mask position with numpy : 0.014926671981811523 nb_pixel_total : 574 time to create 1 rle with old method : 0.0006856918334960938 time for calcul the mask position with numpy : 0.014900445938110352 nb_pixel_total : 1115 time to create 1 rle with old method : 0.0013148784637451172 time for calcul the mask position with numpy : 0.014879941940307617 nb_pixel_total : 778 time to create 1 rle with old method : 0.0009217262268066406 time for calcul the mask position with numpy : 0.01484990119934082 nb_pixel_total : 1619 time to create 1 rle with old method : 0.0018627643585205078 time for calcul the mask position with numpy : 0.016864299774169922 nb_pixel_total : 1014 time to create 1 rle with old method : 0.0012021064758300781 time for calcul the mask position with numpy : 0.015016794204711914 nb_pixel_total : 75 time to create 1 rle with old method : 0.0001125335693359375 time for calcul the mask position with numpy : 0.015009880065917969 nb_pixel_total : 26 time to create 1 rle with old method : 8.20159912109375e-05 time for calcul the mask position with numpy : 0.015052080154418945 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003561973571777344 time for calcul the mask position with numpy : 0.015034914016723633 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004699230194091797 time for calcul the mask position with numpy : 0.014999151229858398 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005612373352050781 time for calcul the mask position with numpy : 0.015320062637329102 nb_pixel_total : 242 time to create 1 rle with old method : 0.00030303001403808594 time for calcul the mask position with numpy : 0.015204668045043945 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005614757537841797 time for calcul the mask position with numpy : 0.015149116516113281 nb_pixel_total : 180 time to create 1 rle with old method : 0.00023055076599121094 time for calcul the mask position with numpy : 0.014949560165405273 nb_pixel_total : 165 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.014995574951171875 nb_pixel_total : 136 time to create 1 rle with old method : 0.00019025802612304688 time for calcul the mask position with numpy : 0.01495671272277832 nb_pixel_total : 24 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.015047311782836914 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002865791320800781 time for calcul the mask position with numpy : 0.015084266662597656 nb_pixel_total : 228 time to create 1 rle with old method : 0.0002865791320800781 time for calcul the mask position with numpy : 0.0152130126953125 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002110004425048828 time for calcul the mask position with numpy : 0.015303850173950195 nb_pixel_total : 863 time to create 1 rle with old method : 0.001035928726196289 time for calcul the mask position with numpy : 0.017135143280029297 nb_pixel_total : 174 time to create 1 rle with old method : 0.00021839141845703125 time for calcul the mask position with numpy : 0.01513361930847168 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007314682006835938 time for calcul the mask position with numpy : 0.015148401260375977 nb_pixel_total : 207 time to create 1 rle with old method : 0.00025653839111328125 time for calcul the mask position with numpy : 0.015191793441772461 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003581047058105469 time for calcul the mask position with numpy : 0.016746044158935547 nb_pixel_total : 391 time to create 1 rle with old method : 0.00047659873962402344 time for calcul the mask position with numpy : 0.015073537826538086 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001227855682373047 time for calcul the mask position with numpy : 0.01564621925354004 nb_pixel_total : 30 time to create 1 rle with old method : 9.226799011230469e-05 time for calcul the mask position with numpy : 0.017934799194335938 nb_pixel_total : 1039 time to create 1 rle with old method : 0.0012345314025878906 time for calcul the mask position with numpy : 0.015166282653808594 nb_pixel_total : 1288 time to create 1 rle with old method : 0.0015213489532470703 time for calcul the mask position with numpy : 0.01654362678527832 nb_pixel_total : 209 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.016161441802978516 nb_pixel_total : 992 time to create 1 rle with old method : 0.0011954307556152344 time for calcul the mask position with numpy : 0.015309810638427734 nb_pixel_total : 2377 time to create 1 rle with old method : 0.002752542495727539 time for calcul the mask position with numpy : 0.015400409698486328 nb_pixel_total : 390 time to create 1 rle with old method : 0.0006937980651855469 time for calcul the mask position with numpy : 0.0181734561920166 nb_pixel_total : 778 time to create 1 rle with old method : 0.0013513565063476562 time for calcul the mask position with numpy : 0.017433881759643555 nb_pixel_total : 1 time to create 1 rle with old method : 8.535385131835938e-05 time for calcul the mask position with numpy : 0.017505168914794922 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002791881561279297 time for calcul the mask position with numpy : 0.022134780883789062 nb_pixel_total : 12450 time to create 1 rle with old method : 0.015526771545410156 time for calcul the mask position with numpy : 0.01523137092590332 nb_pixel_total : 318 time to create 1 rle with old method : 0.00046062469482421875 time for calcul the mask position with numpy : 0.015218257904052734 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003478527069091797 time for calcul the mask position with numpy : 0.01516413688659668 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002779960632324219 time for calcul the mask position with numpy : 0.015801668167114258 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002739429473876953 time for calcul the mask position with numpy : 0.01700305938720703 nb_pixel_total : 1937 time to create 1 rle with old method : 0.002327442169189453 time for calcul the mask position with numpy : 0.015132665634155273 nb_pixel_total : 161 time to create 1 rle with old method : 0.00022268295288085938 create new chi : 3.054539680480957 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.08605575561523438 batch 1 Loaded 161 chid ids of type : 4230 Number RLEs to save : 10831 TO DO : save crop sub photo not yet done ! save time : 0.6881210803985596 nb_obj : 209 nb_hashtags : 5 time to prepare the origin masks : 4.981925964355469 time for calcul the mask position with numpy : 0.22968411445617676 nb_pixel_total : 3465702 time to create 1 rle with new method : 0.26161813735961914 time for calcul the mask position with numpy : 0.013216733932495117 nb_pixel_total : 480 time to create 1 rle with old method : 0.0008540153503417969 time for calcul the mask position with numpy : 0.012620687484741211 nb_pixel_total : 23 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.011772394180297852 nb_pixel_total : 134 time to create 1 rle with old method : 0.00023055076599121094 time for calcul the mask position with numpy : 0.011996746063232422 nb_pixel_total : 136 time to create 1 rle with old method : 0.0003116130828857422 time for calcul the mask position with numpy : 0.012148380279541016 nb_pixel_total : 296 time to create 1 rle with old method : 0.000518798828125 time for calcul the mask position with numpy : 0.011617422103881836 nb_pixel_total : 87 time to create 1 rle with old method : 0.00015282630920410156 time for calcul the mask position with numpy : 0.018954992294311523 nb_pixel_total : 1472 time to create 1 rle with old method : 0.0017931461334228516 time for calcul the mask position with numpy : 0.01839423179626465 nb_pixel_total : 2322 time to create 1 rle with old method : 0.002718687057495117 time for calcul the mask position with numpy : 0.01815199851989746 nb_pixel_total : 1599 time to create 1 rle with old method : 0.0018324851989746094 time for calcul the mask position with numpy : 0.017958641052246094 nb_pixel_total : 4207 time to create 1 rle with old method : 0.005244731903076172 time for calcul the mask position with numpy : 0.019381284713745117 nb_pixel_total : 2887 time to create 1 rle with old method : 0.0033719539642333984 time for calcul the mask position with numpy : 0.018713951110839844 nb_pixel_total : 45695 time to create 1 rle with old method : 0.05122113227844238 time for calcul the mask position with numpy : 0.01926422119140625 nb_pixel_total : 3817 time to create 1 rle with old method : 0.0046596527099609375 time for calcul the mask position with numpy : 0.019442081451416016 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004868507385253906 time for calcul the mask position with numpy : 0.019346237182617188 nb_pixel_total : 806 time to create 1 rle with old method : 0.000986337661743164 time for calcul the mask position with numpy : 0.0201265811920166 nb_pixel_total : 336 time to create 1 rle with old method : 0.0004940032958984375 time for calcul the mask position with numpy : 0.020110607147216797 nb_pixel_total : 1352 time to create 1 rle with old method : 0.001584768295288086 time for calcul the mask position with numpy : 0.018838167190551758 nb_pixel_total : 3617 time to create 1 rle with old method : 0.00436711311340332 time for calcul the mask position with numpy : 0.017998933792114258 nb_pixel_total : 115 time to create 1 rle with old method : 0.0001671314239501953 time for calcul the mask position with numpy : 0.01853036880493164 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.0189969539642334 nb_pixel_total : 117 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.011226415634155273 nb_pixel_total : 1602 time to create 1 rle with old method : 0.0018966197967529297 time for calcul the mask position with numpy : 0.013695240020751953 nb_pixel_total : 289 time to create 1 rle with old method : 0.0004856586456298828 time for calcul the mask position with numpy : 0.014449596405029297 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008885860443115234 time for calcul the mask position with numpy : 0.013707637786865234 nb_pixel_total : 114 time to create 1 rle with old method : 0.0002295970916748047 time for calcul the mask position with numpy : 0.014721870422363281 nb_pixel_total : 234 time to create 1 rle with old method : 0.0005347728729248047 time for calcul the mask position with numpy : 0.015732526779174805 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007560253143310547 time for calcul the mask position with numpy : 0.012383460998535156 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006794929504394531 time for calcul the mask position with numpy : 0.01468515396118164 nb_pixel_total : 588 time to create 1 rle with old method : 0.0008456707000732422 time for calcul the mask position with numpy : 0.014287948608398438 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005259513854980469 time for calcul the mask position with numpy : 0.015301942825317383 nb_pixel_total : 855 time to create 1 rle with old method : 0.0011184215545654297 time for calcul the mask position with numpy : 0.014411449432373047 nb_pixel_total : 106 time to create 1 rle with old method : 0.0001437664031982422 time for calcul the mask position with numpy : 0.011651277542114258 nb_pixel_total : 123 time to create 1 rle with old method : 0.0001838207244873047 time for calcul the mask position with numpy : 0.011955022811889648 nb_pixel_total : 151 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.011684417724609375 nb_pixel_total : 739 time to create 1 rle with old method : 0.0009915828704833984 time for calcul the mask position with numpy : 0.01176905632019043 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005731582641601562 time for calcul the mask position with numpy : 0.012206315994262695 nb_pixel_total : 286 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.011443614959716797 nb_pixel_total : 1702 time to create 1 rle with old method : 0.0020885467529296875 time for calcul the mask position with numpy : 0.01320648193359375 nb_pixel_total : 68 time to create 1 rle with old method : 0.000194549560546875 time for calcul the mask position with numpy : 0.014495849609375 nb_pixel_total : 278 time to create 1 rle with old method : 0.0005099773406982422 time for calcul the mask position with numpy : 0.014485597610473633 nb_pixel_total : 400 time to create 1 rle with old method : 0.0006971359252929688 time for calcul the mask position with numpy : 0.01550602912902832 nb_pixel_total : 230 time to create 1 rle with old method : 0.010052204132080078 time for calcul the mask position with numpy : 0.017391204833984375 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.01512598991394043 nb_pixel_total : 453 time to create 1 rle with old method : 0.0007851123809814453 time for calcul the mask position with numpy : 0.016099929809570312 nb_pixel_total : 217 time to create 1 rle with old method : 0.00038814544677734375 time for calcul the mask position with numpy : 0.02028203010559082 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0022039413452148438 time for calcul the mask position with numpy : 0.012270450592041016 nb_pixel_total : 1343 time to create 1 rle with old method : 0.0016498565673828125 time for calcul the mask position with numpy : 0.01175832748413086 nb_pixel_total : 120 time to create 1 rle with old method : 0.0002815723419189453 time for calcul the mask position with numpy : 0.013327836990356445 nb_pixel_total : 256 time to create 1 rle with old method : 0.00032806396484375 time for calcul the mask position with numpy : 0.011927604675292969 nb_pixel_total : 721 time to create 1 rle with old method : 0.0009541511535644531 time for calcul the mask position with numpy : 0.012266159057617188 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003287792205810547 time for calcul the mask position with numpy : 0.011337995529174805 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.012341737747192383 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006453990936279297 time for calcul the mask position with numpy : 0.012057065963745117 nb_pixel_total : 182 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.011816740036010742 nb_pixel_total : 2943 time to create 1 rle with old method : 0.004564523696899414 time for calcul the mask position with numpy : 0.01287388801574707 nb_pixel_total : 336 time to create 1 rle with old method : 0.0004012584686279297 time for calcul the mask position with numpy : 0.011620759963989258 nb_pixel_total : 435 time to create 1 rle with old method : 0.0007493495941162109 time for calcul the mask position with numpy : 0.011594295501708984 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002841949462890625 time for calcul the mask position with numpy : 0.018821001052856445 nb_pixel_total : 1890 time to create 1 rle with old method : 0.0030896663665771484 time for calcul the mask position with numpy : 0.01877427101135254 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002951622009277344 time for calcul the mask position with numpy : 0.019315481185913086 nb_pixel_total : 55 time to create 1 rle with old method : 0.00016880035400390625 time for calcul the mask position with numpy : 0.025838375091552734 nb_pixel_total : 338 time to create 1 rle with old method : 0.0005323886871337891 time for calcul the mask position with numpy : 0.020343542098999023 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002677440643310547 time for calcul the mask position with numpy : 0.019417762756347656 nb_pixel_total : 28 time to create 1 rle with old method : 0.00011157989501953125 time for calcul the mask position with numpy : 0.021445274353027344 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004487037658691406 time for calcul the mask position with numpy : 0.019985675811767578 nb_pixel_total : 177 time to create 1 rle with old method : 0.00023436546325683594 time for calcul the mask position with numpy : 0.020381927490234375 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007126331329345703 time for calcul the mask position with numpy : 0.014350175857543945 nb_pixel_total : 405 time to create 1 rle with old method : 0.0006344318389892578 time for calcul the mask position with numpy : 0.012998580932617188 nb_pixel_total : 552 time to create 1 rle with old method : 0.0006768703460693359 time for calcul the mask position with numpy : 0.011741876602172852 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003457069396972656 time for calcul the mask position with numpy : 0.011304140090942383 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004680156707763672 time for calcul the mask position with numpy : 0.011415481567382812 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003268718719482422 time for calcul the mask position with numpy : 0.013581275939941406 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005898475646972656 time for calcul the mask position with numpy : 0.012031316757202148 nb_pixel_total : 777 time to create 1 rle with old method : 0.0009553432464599609 time for calcul the mask position with numpy : 0.012066841125488281 nb_pixel_total : 41 time to create 1 rle with old method : 0.00010085105895996094 time for calcul the mask position with numpy : 0.0118255615234375 nb_pixel_total : 164 time to create 1 rle with old method : 0.00022125244140625 time for calcul the mask position with numpy : 0.011177778244018555 nb_pixel_total : 261 time to create 1 rle with old method : 0.00033736228942871094 time for calcul the mask position with numpy : 0.011172771453857422 nb_pixel_total : 614 time to create 1 rle with old method : 0.0007474422454833984 time for calcul the mask position with numpy : 0.01113581657409668 nb_pixel_total : 120 time to create 1 rle with old method : 0.00015974044799804688 time for calcul the mask position with numpy : 0.011281728744506836 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008237361907958984 time for calcul the mask position with numpy : 0.012825727462768555 nb_pixel_total : 1081 time to create 1 rle with old method : 0.001331329345703125 time for calcul the mask position with numpy : 0.011765480041503906 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.011661291122436523 nb_pixel_total : 166 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.011612892150878906 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.011333227157592773 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005774497985839844 time for calcul the mask position with numpy : 0.011408329010009766 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005066394805908203 time for calcul the mask position with numpy : 0.011020183563232422 nb_pixel_total : 312 time to create 1 rle with old method : 0.0003783702850341797 time for calcul the mask position with numpy : 0.011052608489990234 nb_pixel_total : 882 time to create 1 rle with old method : 0.0010356903076171875 time for calcul the mask position with numpy : 0.010902166366577148 nb_pixel_total : 238 time to create 1 rle with old method : 0.0002880096435546875 time for calcul the mask position with numpy : 0.010898351669311523 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004818439483642578 time for calcul the mask position with numpy : 0.010963678359985352 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0016982555389404297 time for calcul the mask position with numpy : 0.011770248413085938 nb_pixel_total : 475 time to create 1 rle with old method : 0.0008580684661865234 time for calcul the mask position with numpy : 0.01142120361328125 nb_pixel_total : 82 time to create 1 rle with old method : 0.00011849403381347656 time for calcul the mask position with numpy : 0.010637521743774414 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002846717834472656 time for calcul the mask position with numpy : 0.010874509811401367 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003414154052734375 time for calcul the mask position with numpy : 0.011056661605834961 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005860328674316406 time for calcul the mask position with numpy : 0.010693550109863281 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008037090301513672 time for calcul the mask position with numpy : 0.010300636291503906 nb_pixel_total : 197 time to create 1 rle with old method : 0.00024175643920898438 time for calcul the mask position with numpy : 0.010753870010375977 nb_pixel_total : 361 time to create 1 rle with old method : 0.00043082237243652344 time for calcul the mask position with numpy : 0.010676860809326172 nb_pixel_total : 493 time to create 1 rle with old method : 0.0005922317504882812 time for calcul the mask position with numpy : 0.011012792587280273 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001373291015625 time for calcul the mask position with numpy : 0.010816097259521484 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0016009807586669922 time for calcul the mask position with numpy : 0.011324644088745117 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005404949188232422 time for calcul the mask position with numpy : 0.010810136795043945 nb_pixel_total : 156 time to create 1 rle with old method : 0.00019931793212890625 time for calcul the mask position with numpy : 0.010790824890136719 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006656646728515625 time for calcul the mask position with numpy : 0.010712385177612305 nb_pixel_total : 192 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.011859655380249023 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001800060272216797 time for calcul the mask position with numpy : 0.010363101959228516 nb_pixel_total : 260 time to create 1 rle with old method : 0.00030517578125 time for calcul the mask position with numpy : 0.010291099548339844 nb_pixel_total : 543 time to create 1 rle with old method : 0.0005915164947509766 time for calcul the mask position with numpy : 0.01035618782043457 nb_pixel_total : 1030 time to create 1 rle with old method : 0.0011878013610839844 time for calcul the mask position with numpy : 0.010898113250732422 nb_pixel_total : 214 time to create 1 rle with old method : 0.00027060508728027344 time for calcul the mask position with numpy : 0.014584779739379883 nb_pixel_total : 119 time to create 1 rle with old method : 0.00018095970153808594 time for calcul the mask position with numpy : 0.010528802871704102 nb_pixel_total : 157 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.010499238967895508 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002579689025878906 time for calcul the mask position with numpy : 0.010806798934936523 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006718635559082031 time for calcul the mask position with numpy : 0.010858535766601562 nb_pixel_total : 326 time to create 1 rle with old method : 0.0003809928894042969 time for calcul the mask position with numpy : 0.010488748550415039 nb_pixel_total : 58 time to create 1 rle with old method : 8.20159912109375e-05 time for calcul the mask position with numpy : 0.01040029525756836 nb_pixel_total : 1460 time to create 1 rle with old method : 0.0016939640045166016 time for calcul the mask position with numpy : 0.01035761833190918 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002105236053466797 time for calcul the mask position with numpy : 0.010876893997192383 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001838207244873047 time for calcul the mask position with numpy : 0.011054754257202148 nb_pixel_total : 557 time to create 1 rle with old method : 0.0006864070892333984 time for calcul the mask position with numpy : 0.011361122131347656 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003135204315185547 time for calcul the mask position with numpy : 0.01089024543762207 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005199909210205078 time for calcul the mask position with numpy : 0.010548830032348633 nb_pixel_total : 696 time to create 1 rle with old method : 0.0008027553558349609 time for calcul the mask position with numpy : 0.010717630386352539 nb_pixel_total : 2032 time to create 1 rle with old method : 0.0022847652435302734 time for calcul the mask position with numpy : 0.010698080062866211 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006604194641113281 time for calcul the mask position with numpy : 0.010814666748046875 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007071495056152344 time for calcul the mask position with numpy : 0.012166500091552734 nb_pixel_total : 823 time to create 1 rle with old method : 0.001432657241821289 time for calcul the mask position with numpy : 0.012589454650878906 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002460479736328125 time for calcul the mask position with numpy : 0.012476205825805664 nb_pixel_total : 677 time to create 1 rle with old method : 0.001054525375366211 time for calcul the mask position with numpy : 0.01205134391784668 nb_pixel_total : 273 time to create 1 rle with old method : 0.0005006790161132812 time for calcul the mask position with numpy : 0.01214146614074707 nb_pixel_total : 75 time to create 1 rle with old method : 0.00013184547424316406 time for calcul the mask position with numpy : 0.011821269989013672 nb_pixel_total : 579 time to create 1 rle with old method : 0.0009915828704833984 time for calcul the mask position with numpy : 0.012049436569213867 nb_pixel_total : 333 time to create 1 rle with old method : 0.0006639957427978516 time for calcul the mask position with numpy : 0.012121200561523438 nb_pixel_total : 25 time to create 1 rle with old method : 0.0001342296600341797 time for calcul the mask position with numpy : 0.011525154113769531 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0015363693237304688 time for calcul the mask position with numpy : 0.01116490364074707 nb_pixel_total : 290 time to create 1 rle with old method : 0.0004107952117919922 time for calcul the mask position with numpy : 0.011567831039428711 nb_pixel_total : 46 time to create 1 rle with old method : 0.0001583099365234375 time for calcul the mask position with numpy : 0.011072874069213867 nb_pixel_total : 617 time to create 1 rle with old method : 0.0008792877197265625 time for calcul the mask position with numpy : 0.011225223541259766 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004038810729980469 time for calcul the mask position with numpy : 0.01038217544555664 nb_pixel_total : 159 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.010470151901245117 nb_pixel_total : 291 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.010686635971069336 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001232624053955078 time for calcul the mask position with numpy : 0.010719776153564453 nb_pixel_total : 334 time to create 1 rle with old method : 0.0003986358642578125 time for calcul the mask position with numpy : 0.010788917541503906 nb_pixel_total : 834 time to create 1 rle with old method : 0.0010128021240234375 time for calcul the mask position with numpy : 0.01080179214477539 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.011547327041625977 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002694129943847656 time for calcul the mask position with numpy : 0.012239217758178711 nb_pixel_total : 186 time to create 1 rle with old method : 0.00029087066650390625 time for calcul the mask position with numpy : 0.01221609115600586 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005047321319580078 time for calcul the mask position with numpy : 0.012160778045654297 nb_pixel_total : 984 time to create 1 rle with old method : 0.0016007423400878906 time for calcul the mask position with numpy : 0.012401819229125977 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003345012664794922 time for calcul the mask position with numpy : 0.012009620666503906 nb_pixel_total : 212 time to create 1 rle with old method : 0.00036597251892089844 time for calcul the mask position with numpy : 0.012437582015991211 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003085136413574219 time for calcul the mask position with numpy : 0.012393474578857422 nb_pixel_total : 2115 time to create 1 rle with old method : 0.002611398696899414 time for calcul the mask position with numpy : 0.012500286102294922 nb_pixel_total : 1121 time to create 1 rle with old method : 0.0014033317565917969 time for calcul the mask position with numpy : 0.011634111404418945 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005500316619873047 time for calcul the mask position with numpy : 0.01270604133605957 nb_pixel_total : 297 time to create 1 rle with old method : 0.00042557716369628906 time for calcul the mask position with numpy : 0.012216806411743164 nb_pixel_total : 238 time to create 1 rle with old method : 0.00031828880310058594 time for calcul the mask position with numpy : 0.010871648788452148 nb_pixel_total : 440 time to create 1 rle with old method : 0.0004966259002685547 time for calcul the mask position with numpy : 0.01088714599609375 nb_pixel_total : 143 time to create 1 rle with old method : 0.00018095970153808594 time for calcul the mask position with numpy : 0.0146331787109375 nb_pixel_total : 1489 time to create 1 rle with old method : 0.0017316341400146484 time for calcul the mask position with numpy : 0.015185832977294922 nb_pixel_total : 638 time to create 1 rle with old method : 0.00067901611328125 time for calcul the mask position with numpy : 0.014990568161010742 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002532005310058594 time for calcul the mask position with numpy : 0.014661312103271484 nb_pixel_total : 9181 time to create 1 rle with old method : 0.010505914688110352 time for calcul the mask position with numpy : 0.015000581741333008 nb_pixel_total : 512 time to create 1 rle with old method : 0.0005908012390136719 time for calcul the mask position with numpy : 0.014725685119628906 nb_pixel_total : 414 time to create 1 rle with old method : 0.0004780292510986328 time for calcul the mask position with numpy : 0.014702081680297852 nb_pixel_total : 602 time to create 1 rle with old method : 0.0007014274597167969 time for calcul the mask position with numpy : 0.014710187911987305 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005128383636474609 time for calcul the mask position with numpy : 0.01465463638305664 nb_pixel_total : 124 time to create 1 rle with old method : 0.00015306472778320312 time for calcul the mask position with numpy : 0.014739990234375 nb_pixel_total : 2027 time to create 1 rle with old method : 0.0023834705352783203 time for calcul the mask position with numpy : 0.014800071716308594 nb_pixel_total : 804 time to create 1 rle with old method : 0.0009524822235107422 time for calcul the mask position with numpy : 0.014939546585083008 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002608299255371094 time for calcul the mask position with numpy : 0.015089988708496094 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003428459167480469 time for calcul the mask position with numpy : 0.014988183975219727 nb_pixel_total : 296 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.015282392501831055 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005478858947753906 time for calcul the mask position with numpy : 0.01755237579345703 nb_pixel_total : 1039 time to create 1 rle with old method : 0.001224517822265625 time for calcul the mask position with numpy : 0.014805078506469727 nb_pixel_total : 673 time to create 1 rle with old method : 0.0008249282836914062 time for calcul the mask position with numpy : 0.014829635620117188 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008950233459472656 time for calcul the mask position with numpy : 0.015048027038574219 nb_pixel_total : 353 time to create 1 rle with old method : 0.0003898143768310547 time for calcul the mask position with numpy : 0.014846324920654297 nb_pixel_total : 388 time to create 1 rle with old method : 0.0004951953887939453 time for calcul the mask position with numpy : 0.015035867691040039 nb_pixel_total : 587 time to create 1 rle with old method : 0.0006406307220458984 time for calcul the mask position with numpy : 0.01505136489868164 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004341602325439453 time for calcul the mask position with numpy : 0.014492988586425781 nb_pixel_total : 262 time to create 1 rle with old method : 0.00032210350036621094 time for calcul the mask position with numpy : 0.014333963394165039 nb_pixel_total : 246 time to create 1 rle with old method : 0.0002899169921875 time for calcul the mask position with numpy : 0.014590978622436523 nb_pixel_total : 241 time to create 1 rle with old method : 0.0002932548522949219 time for calcul the mask position with numpy : 0.014475107192993164 nb_pixel_total : 1267 time to create 1 rle with old method : 0.0013778209686279297 time for calcul the mask position with numpy : 0.014478683471679688 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002474784851074219 time for calcul the mask position with numpy : 0.014638423919677734 nb_pixel_total : 49245 time to create 1 rle with old method : 0.05560469627380371 time for calcul the mask position with numpy : 0.01459193229675293 nb_pixel_total : 302 time to create 1 rle with old method : 0.00034236907958984375 time for calcul the mask position with numpy : 0.015118122100830078 nb_pixel_total : 92 time to create 1 rle with old method : 0.00013136863708496094 time for calcul the mask position with numpy : 0.014490365982055664 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003523826599121094 time for calcul the mask position with numpy : 0.01449441909790039 nb_pixel_total : 490 time to create 1 rle with old method : 0.00057220458984375 time for calcul the mask position with numpy : 0.014595985412597656 nb_pixel_total : 357 time to create 1 rle with old method : 0.00047087669372558594 time for calcul the mask position with numpy : 0.014730453491210938 nb_pixel_total : 29 time to create 1 rle with old method : 6.318092346191406e-05 time for calcul the mask position with numpy : 0.014467477798461914 nb_pixel_total : 1089 time to create 1 rle with old method : 0.001283407211303711 time for calcul the mask position with numpy : 0.014642000198364258 nb_pixel_total : 1437 time to create 1 rle with old method : 0.0016753673553466797 time for calcul the mask position with numpy : 0.015089035034179688 nb_pixel_total : 6 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.014899015426635742 nb_pixel_total : 957 time to create 1 rle with old method : 0.001283407211303711 time for calcul the mask position with numpy : 0.01522684097290039 nb_pixel_total : 117 time to create 1 rle with old method : 0.00015854835510253906 time for calcul the mask position with numpy : 0.01529383659362793 nb_pixel_total : 2466 time to create 1 rle with old method : 0.002985715866088867 time for calcul the mask position with numpy : 0.015850543975830078 nb_pixel_total : 397 time to create 1 rle with old method : 0.0007486343383789062 time for calcul the mask position with numpy : 0.018765687942504883 nb_pixel_total : 617 time to create 1 rle with old method : 0.001171112060546875 time for calcul the mask position with numpy : 0.01765918731689453 nb_pixel_total : 185 time to create 1 rle with old method : 0.00027823448181152344 time for calcul the mask position with numpy : 0.015803813934326172 nb_pixel_total : 171 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.01617264747619629 nb_pixel_total : 264 time to create 1 rle with old method : 0.000507354736328125 time for calcul the mask position with numpy : 0.017463207244873047 nb_pixel_total : 224 time to create 1 rle with old method : 0.0004248619079589844 time for calcul the mask position with numpy : 0.016975879669189453 nb_pixel_total : 219 time to create 1 rle with old method : 0.0004296302795410156 time for calcul the mask position with numpy : 0.015998363494873047 nb_pixel_total : 1918 time to create 1 rle with old method : 0.0023708343505859375 time for calcul the mask position with numpy : 0.015358209609985352 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003514289855957031 create new chi : 3.641066312789917 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0022535324096679688 batch 1 Loaded 210 chid ids of type : 4230 Number RLEs to save : 14392 TO DO : save crop sub photo not yet done ! save time : 0.8938887119293213 map_output_result : {1340584307: (0.0, 'Should be the crop_list due to order', 0.0), 1340583079: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340584307, 1340583079] Looping around the photos to save general results len do output : 2 /1340584307.Didn't retrieve data . /1340583079.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340584307', None, None, None, None, None, '2628013') ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340583079', None, None, None, None, None, '2628013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.018403291702270508 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.111719608306885 time spend to save output : 0.018779993057250977 total time spend for step 4 : 16.130499601364136 step5:crop_condition Mon Mar 3 07:21:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 371 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 235 About to insert : list_path_to_insert length 235 new photo from crops ! About to upload 235 photos upload in portfolio : 4869462 init cache_photo without model_param we have 235 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740982885_709779 we have uploaded 235 photos in the portfolio 4869462 time of upload the photos Elapsed time : 56.21348166465759 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 4869462 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740982942_709779 we have uploaded 24 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.1541664600372314 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 4869462 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740982949_709779 we have uploaded 12 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.157604217529297 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 4869462 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740982954_709779 we have uploaded 7 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.2868525981903076 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340584307, 1340583079] Looping around the photos to save general results len do output : 278 /1340587362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340587695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340584307', None, None, None, None, None, '2628013') ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340583079', None, None, None, None, None, '2628013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 836 time used for this insertion : 0.05291342735290527 save_final save missing photos in datou_result : time spend for datou_step_exec : 76.43583750724792 time spend to save output : 0.06272053718566895 total time spend for step 5 : 76.4985580444336 step6:thcl Mon Mar 3 07:22:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01896071434020996 time to convert the images to numpy array : 0.07030153274536133 time to import caffe and check if the image exist : 0.02819514274597168 time to convert the images to numpy array : 0.06923055648803711 time to import caffe and check if the image exist : 0.02340865135192871 time to convert the images to numpy array : 0.08041548728942871 time to import caffe and check if the image exist : 0.012549638748168945 time to convert the images to numpy array : 0.09925961494445801 time to import caffe and check if the image exist : 0.02546977996826172 time to convert the images to numpy array : 0.08663296699523926 time to import caffe and check if the image exist : 0.014207601547241211 time to convert the images to numpy array : 0.10055232048034668 time to import caffe and check if the image exist : 0.020044803619384766 time to convert the images to numpy array : 0.09527873992919922 time to import caffe and check if the image exist : 0.02741527557373047 time to convert the images to numpy array : 0.08914923667907715 time to import caffe and check if the image exist : 0.019269227981567383 time to convert the images to numpy array : 0.09722137451171875 time to import caffe and check if the image exist : 0.026474714279174805 time to convert the images to numpy array : 0.09165382385253906 total time to convert the images to numpy array : 0.3782539367675781 list photo_ids error: [] list photo_ids correct : [1340587523, 1340587527, 1340587530, 1340587531, 1340587532, 1340587533, 1340587534, 1340587535, 1340587536, 1340587537, 1340587539, 1340587540, 1340587541, 1340587542, 1340587543, 1340587544, 1340587545, 1340587546, 1340587547, 1340587548, 1340587550, 1340587552, 1340587554, 1340587555, 1340587556, 1340587557, 1340587558, 1340587559, 1340587560, 1340587561, 1340587562, 1340587564, 1340587565, 1340587566, 1340587568, 1340587569, 1340587570, 1340587571, 1340587572, 1340587573, 1340587574, 1340587577, 1340587578, 1340587579, 1340587580, 1340587581, 1340587582, 1340587583, 1340587584, 1340587585, 1340587586, 1340587587, 1340587588, 1340587589, 1340587590, 1340587591, 1340587592, 1340587593, 1340587594, 1340587595, 1340587596, 1340587597, 1340587598, 1340587599, 1340587600, 1340587601, 1340587602, 1340587603, 1340587604, 1340587605, 1340587606, 1340587607, 1340587608, 1340587609, 1340587610, 1340587611, 1340587612, 1340587613, 1340587614, 1340587615, 1340587616, 1340587617, 1340587618, 1340587619, 1340587362, 1340587363, 1340587364, 1340587366, 1340587370, 1340587374, 1340587376, 1340587377, 1340587378, 1340587379, 1340587380, 1340587381, 1340587382, 1340587383, 1340587384, 1340587385, 1340587386, 1340587387, 1340587388, 1340587389, 1340587390, 1340587391, 1340587392, 1340587393, 1340587394, 1340587397, 1340587398, 1340587399, 1340587663, 1340587664, 1340587665, 1340587666, 1340587668, 1340587669, 1340587670, 1340587674, 1340587675, 1340587676, 1340587677, 1340587678, 1340587679, 1340587680, 1340587681, 1340587682, 1340587683, 1340587684, 1340587685, 1340587688, 1340587689, 1340587690, 1340587692, 1340587693, 1340587694, 1340587695, 1340587461, 1340587462, 1340587463, 1340587464, 1340587465, 1340587466, 1340587467, 1340587468, 1340587469, 1340587470, 1340587471, 1340587472, 1340587473, 1340587474, 1340587475, 1340587476, 1340587477, 1340587478, 1340587479, 1340587480, 1340587481, 1340587482, 1340587483, 1340587484, 1340587485, 1340587486, 1340587487, 1340587488, 1340587489, 1340587490, 1340587491, 1340587492, 1340587493, 1340587494, 1340587495, 1340587496, 1340587497, 1340587498, 1340587499, 1340587500, 1340587501, 1340587502, 1340587503, 1340587504, 1340587505, 1340587506, 1340587507, 1340587508, 1340587509, 1340587510, 1340587511, 1340587512, 1340587513, 1340587514, 1340587515, 1340587519, 1340587400, 1340587401, 1340587402, 1340587403, 1340587404, 1340587405, 1340587406, 1340587407, 1340587408, 1340587409, 1340587410, 1340587411, 1340587412, 1340587413, 1340587414, 1340587415, 1340587416, 1340587417, 1340587418, 1340587419, 1340587420, 1340587421, 1340587422, 1340587423, 1340587424, 1340587425, 1340587426, 1340587427, 1340587620, 1340587621, 1340587622, 1340587623, 1340587624, 1340587625, 1340587626, 1340587627, 1340587628, 1340587629, 1340587630, 1340587643, 1340587644, 1340587645, 1340587646, 1340587647, 1340587648, 1340587649, 1340587650, 1340587651, 1340587652, 1340587653, 1340587654, 1340587655, 1340587656, 1340587660, 1340587661, 1340587662, 1340587428, 1340587429, 1340587430, 1340587431, 1340587432, 1340587434, 1340587436, 1340587437, 1340587438, 1340587439, 1340587440, 1340587441, 1340587443, 1340587444, 1340587445, 1340587446, 1340587448, 1340587449, 1340587450, 1340587451, 1340587452, 1340587453, 1340587454, 1340587455, 1340587456, 1340587457, 1340587458, 1340587459] number of photos to traite : 278 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10595 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.3526160717010498 time used to do the prediction : 1.1150751113891602 save descriptor for thcl : 3237 time to traite the descriptors : 1.6752288341522217 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340587523 To insert : 1340587527 To insert : 1340587530 To insert : 1340587531 To insert : 1340587532 To insert : 1340587533 To insert : 1340587534 To insert : 1340587535 To insert : 1340587536 To insert : 1340587537 To insert : 1340587539 To insert : 1340587540 To insert : 1340587541 To insert : 1340587542 To insert : 1340587543 To insert : 1340587544 To insert : 1340587545 To insert : 1340587546 To insert : 1340587547 To insert : 1340587548 To insert : 1340587550 To insert : 1340587552 To insert : 1340587554 To insert : 1340587555 To insert : 1340587556 To insert : 1340587557 To insert : 1340587558 To insert : 1340587559 To insert : 1340587560 To insert : 1340587561 To insert : 1340587562 To insert : 1340587564 To insert : 1340587565 To insert : 1340587566 To insert : 1340587568 To insert : 1340587569 To insert : 1340587570 To insert : 1340587571 To insert : 1340587572 To insert : 1340587573 To insert : 1340587574 To insert : 1340587577 To insert : 1340587578 To insert : 1340587579 To insert : 1340587580 To insert : 1340587581 To insert : 1340587582 To insert : 1340587583 To insert : 1340587584 To insert : 1340587585 To insert : 1340587586 To insert : 1340587587 To insert : 1340587588 To insert : 1340587589 To insert : 1340587590 To insert : 1340587591 To insert : 1340587592 To insert : 1340587593 To insert : 1340587594 To insert : 1340587595 To insert : 1340587596 To insert : 1340587597 To insert : 1340587598 To insert : 1340587599 To insert : 1340587600 To insert : 1340587601 To insert : 1340587602 To insert : 1340587603 To insert : 1340587604 To insert : 1340587605 To insert : 1340587606 To insert : 1340587607 To insert : 1340587608 To insert : 1340587609 To insert : 1340587610 To insert : 1340587611 To insert : 1340587612 To insert : 1340587613 To insert : 1340587614 To insert : 1340587615 To insert : 1340587616 To insert : 1340587617 To insert : 1340587618 To insert : 1340587619 To insert : 1340587362 To insert : 1340587363 To insert : 1340587364 To insert : 1340587366 To insert : 1340587370 To insert : 1340587374 To insert : 1340587376 To insert : 1340587377 To insert : 1340587378 To insert : 1340587379 To insert : 1340587380 To insert : 1340587381 To insert : 1340587382 To insert : 1340587383 To insert : 1340587384 To insert : 1340587385 To insert : 1340587386 To insert : 1340587387 To insert : 1340587388 To insert : 1340587389 To insert : 1340587390 To insert : 1340587391 To insert : 1340587392 To insert : 1340587393 To insert : 1340587394 To insert : 1340587397 To insert : 1340587398 To insert : 1340587399 To insert : 1340587663 To insert : 1340587664 To insert : 1340587665 To insert : 1340587666 To insert : 1340587668 To insert : 1340587669 To insert : 1340587670 To insert : 1340587674 To insert : 1340587675 To insert : 1340587676 To insert : 1340587677 To insert : 1340587678 To insert : 1340587679 To insert : 1340587680 To insert : 1340587681 To insert : 1340587682 To insert : 1340587683 To insert : 1340587684 To insert : 1340587685 To insert : 1340587688 To insert : 1340587689 To insert : 1340587690 To insert : 1340587692 To insert : 1340587693 To insert : 1340587694 To insert : 1340587695 To insert : 1340587461 To insert : 1340587462 To insert : 1340587463 To insert : 1340587464 To insert : 1340587465 To insert : 1340587466 To insert : 1340587467 To insert : 1340587468 To insert : 1340587469 To insert : 1340587470 To insert : 1340587471 To insert : 1340587472 To insert : 1340587473 To insert : 1340587474 To insert : 1340587475 To insert : 1340587476 To insert : 1340587477 To insert : 1340587478 To insert : 1340587479 To insert : 1340587480 To insert : 1340587481 To insert : 1340587482 To insert : 1340587483 To insert : 1340587484 To insert : 1340587485 To insert : 1340587486 To insert : 1340587487 To insert : 1340587488 To insert : 1340587489 To insert : 1340587490 To insert : 1340587491 To insert : 1340587492 To insert : 1340587493 To insert : 1340587494 To insert : 1340587495 To insert : 1340587496 To insert : 1340587497 To insert : 1340587498 To insert : 1340587499 To insert : 1340587500 To insert : 1340587501 To insert : 1340587502 To insert : 1340587503 To insert : 1340587504 To insert : 1340587505 To insert : 1340587506 To insert : 1340587507 To insert : 1340587508 To insert : 1340587509 To insert : 1340587510 To insert : 1340587511 To insert : 1340587512 To insert : 1340587513 To insert : 1340587514 To insert : 1340587515 To insert : 1340587519 To insert : 1340587400 To insert : 1340587401 To insert : 1340587402 To insert : 1340587403 To insert : 1340587404 To insert : 1340587405 To insert : 1340587406 To insert : 1340587407 To insert : 1340587408 To insert : 1340587409 To insert : 1340587410 To insert : 1340587411 To insert : 1340587412 To insert : 1340587413 To insert : 1340587414 To insert : 1340587415 To insert : 1340587416 To insert : 1340587417 To insert : 1340587418 To insert : 1340587419 To insert : 1340587420 To insert : 1340587421 To insert : 1340587422 To insert : 1340587423 To insert : 1340587424 To insert : 1340587425 To insert : 1340587426 To insert : 1340587427 To insert : 1340587620 To insert : 1340587621 To insert : 1340587622 To insert : 1340587623 To insert : 1340587624 To insert : 1340587625 To insert : 1340587626 To insert : 1340587627 To insert : 1340587628 To insert : 1340587629 To insert : 1340587630 To insert : 1340587643 To insert : 1340587644 To insert : 1340587645 To insert : 1340587646 To insert : 1340587647 To insert : 1340587648 To insert : 1340587649 To insert : 1340587650 To insert : 1340587651 To insert : 1340587652 To insert : 1340587653 To insert : 1340587654 To insert : 1340587655 To insert : 1340587656 To insert : 1340587660 To insert : 1340587661 To insert : 1340587662 To insert : 1340587428 To insert : 1340587429 To insert : 1340587430 To insert : 1340587431 To insert : 1340587432 To insert : 1340587434 To insert : 1340587436 To insert : 1340587437 To insert : 1340587438 To insert : 1340587439 To insert : 1340587440 To insert : 1340587441 To insert : 1340587443 To insert : 1340587444 To insert : 1340587445 To insert : 1340587446 To insert : 1340587448 To insert : 1340587449 To insert : 1340587450 To insert : 1340587451 To insert : 1340587452 To insert : 1340587453 To insert : 1340587454 To insert : 1340587455 To insert : 1340587456 To insert : 1340587457 To insert : 1340587458 To insert : 1340587459 time to insert the descriptors : 58.52904415130615 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 418 time used for this insertion : 0.0368497371673584 save missing photos in datou_result : time spend for datou_step_exec : 67.12491226196289 time spend to save output : 0.09121417999267578 total time spend for step 6 : 67.21612644195557 step7:ventilate_hashtags_in_portfolio Mon Mar 3 07:23:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20963096 get user id for portfolio 20963096 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20963096 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','pet_fonce','environnement','Papier','mal_croppe','Carton','pet_clair','PET_clair','PEHD','papier','flou','autre','pehd','Tetrapak','Film_plastique','refus','metal','carton')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20963096 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','pet_fonce','environnement','Papier','mal_croppe','Carton','pet_clair','PET_clair','PEHD','papier','flou','autre','pehd','Tetrapak','Film_plastique','refus','metal','carton')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20963096 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','pet_fonce','environnement','Papier','mal_croppe','Carton','pet_clair','PET_clair','PEHD','papier','flou','autre','pehd','Tetrapak','Film_plastique','refus','metal','carton')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20963096 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','pet_fonce','environnement','Papier','mal_croppe','Carton','pet_clair','PET_clair','PEHD','papier','flou','autre','pehd','Tetrapak','Film_plastique','refus','metal','carton')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20964050,20964051,20964058,20964053,20964066,20964056,20964061,20964059,20964060,20964062,20964063,20964064,20964065?tags=pet_fonce,environnement,papier,mal_croppe,carton,pet_clair,pehd,flou,autre,tetrapak,film_plastique,refus,metal&datou_id_consolidate=4235&port_consolidate=20963096 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340584307, 1340583079] Looping around the photos to save general results len do output : 1 /20963096. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340584307', None, None, None, None, None, '2628013') ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340583079', None, None, None, None, None, '2628013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.018091678619384766 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2308788299560547 time spend to save output : 0.018355131149291992 total time spend for step 7 : 2.2492339611053467 step8:final Mon Mar 3 07:23:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340584307: ('0.8816488966579692',), 1340583079: ('0.8816488966579692',)} new output for save of step final : {1340584307: ('0.8816488966579692',), 1340583079: ('0.8816488966579692',)} [1340584307, 1340583079] Looping around the photos to save general results len do output : 2 /1340584307.Didn't retrieve data . /1340583079.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340584307', None, None, None, None, None, '2628013') ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340583079', None, None, None, None, None, '2628013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012513399124145508 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11314201354980469 time spend to save output : 0.013077735900878906 total time spend for step 8 : 0.1262197494506836 step9:velours_tree Mon Mar 3 07:23:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20964050,20964051,20964058,20964053,20964066,20964056,20964061,20964059,20964060,20964062,20964063,20964064,20964065 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964050 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964051 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964058 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964053 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964066 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964056 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964061 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964059 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964060 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964062 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964063 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964064 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20964065 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 278 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 1 0 1 0 4 2 1 5 0 2 2 0 5 1 5 0 0 0 5 2 1 2 1 0 0 2 2 0 5 0 5 1 0 2 5 0 5 3 5 5 1 2 0 5 0 5 3 0 5 5 0 0 2 1 5 5 2 5 5 0 5 3 0 0 5 1 5 3 1 2 3 0 3 1 2 0 1 0 4 1 0 3 0 1 2 0 2 2 2 0 4 2 2 1 0 1 1 1 1 2 2 1 2 0 4 0 0 1 0 2 1 5 0 0 2 3 5 1 3 1 1 0 1 0 0 2 1 0 3 2 3 3 2 3 0 2 0 1 2 0 2 0 5 4 5 4 3 5 0 2 0 5 1 1 5 1 0 5 0 0 5 2 3 2 0 0 0 4 0 0 3 0 0 0 0 2 2 2 0 3 1 5 5 1 0 3 5 1 5 5 0 0 2 5 0 5 0 3 1 2 3 0 5 0 0 0 2 5 0 5 1 2 0 0 2 0 1 0 2 4 1 2 2 0 4 2 0 2 2 3 2 1 1 1 4 2 2 2 4 2 1 2 2 2 1 2 2 1 2 1 1 3 3 1 3 4 2 2 5 3 2 3 5 3 0 2 0 1 2 2 2 5 4 3 1 2 4] Elapsed time: 0.04622364044189453 graph_id used : 81139 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20964050,20964051,20964058,20964053,20964066,20964056,20964061,20964059,20964060,20964062,20964063,20964064,20964065?tags=pet_fonce,environnement,papier,mal_croppe,carton,pet_clair,pehd,flou,autre,tetrapak,film_plastique,refus,metal&datou_id_consolidate=4235&port_consolidate=20963096&tree_id=81139 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340584307, 1340583079] Looping around the photos to save general results len do output : 1 /20963096Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340584307', None, None, None, None, None, '2628013') ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340583079', None, None, None, None, None, '2628013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012048959732055664 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.6079523563385 time spend to save output : 0.012455463409423828 total time spend for step 9 : 18.620407819747925 step10:send_mail_cod Mon Mar 3 07:24:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20963096_03-03-2025_07_24_04.pdf 20964032 imagette209640321740983044 20964040 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209640401740983044 20964035 imagette209640351740983045 20964048 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209640481740983045 20964038 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209640381740983046 20964043 imagette209640431740983047 20964041 imagette209640411740983047 20964042 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209640421740983047 20964044 imagette209640441740983047 20964045 imagette209640451740983047 20964046 imagette209640461740983047 20964047 imagette209640471740983047 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20963096 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20964050,20964051,20964058,20964053,20964066,20964056,20964061,20964059,20964060,20964062,20964063,20964064,20964065?tags=pet_fonce,environnement,papier,mal_croppe,carton,pet_clair,pehd,flou,autre,tetrapak,film_plastique,refus,metal&datou_id_consolidate=4235&port_consolidate=20963096&tree_id=81139 your option no_mail is active, we will not send the real mail to your client args[1340584307] : ((1340584307, -7.562624003701244, 492609224), (1340584307, 0.2819296643955039, 2107752395), '0.8816488966579692') We are sending mail with results at cod@fotonower.com args[1340583079] : ((1340583079, -7.541931502321915, 492609224), (1340583079, 0.28277767422134503, 2107752395), '0.8816488966579692') We are sending mail with results at cod@fotonower.com refus_total : 0.8816488966579692 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20963096 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20963096_03-03-2025_07_24_04.pdf results_Qualipapia_P20963096_03-03-2025_07_24_04.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20963096_03-03-2025_07_24_04.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20963096','results_Qualipapia_P20963096_03-03-2025_07_24_04.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20963096_03-03-2025_07_24_04.pdf','pdf','','0.15','0.8816488966579692') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340584307, 1340583079] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340584307', None, None, None, None, None, '2628013') ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340583079', None, None, None, None, None, '2628013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012427806854248047 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.957287073135376 time spend to save output : 0.012613773345947266 total time spend for step 10 : 3.9699008464813232 step11:split_time_score Mon Mar 3 07:24:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03032025 20963096 Nombre de photos uploadées : 2 / 23040 (0%) 03032025 20963096 Nombre de photos taguées (types de déchets): 0 / 2 (0%) 03032025 20963096 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 7.152557373046875e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00020432472229003906 elapsed_time : insert_dashboard_record_day_entry 0.022599220275878906 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.8691090355703879 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20958330_03-03-2025_02_17_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20958330 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20958330 AND mptpi.`type`=4230 To do Qualite : 0.8555041909864138 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20958331_03-03-2025_02_20_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20958331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20958331 AND mptpi.`type`=4230 To do Qualite : 0.8313881161900543 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20958862_03-03-2025_03_17_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20958862 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20958862 AND mptpi.`type`=4230 To do Qualite : 0.8410204516055618 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20959628_03-03-2025_04_05_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20959628 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20959628 AND mptpi.`type`=4230 To do Qualite : 0.8344046614403847 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20960227_03-03-2025_05_03_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20960227 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20960227 AND mptpi.`type`=4230 To do Qualite : 0.8410015622920821 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20961241_03-03-2025_06_21_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20961241 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20961241 AND mptpi.`type`=4230 To do Qualite : 0.8816488966579692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20963096_03-03-2025_07_24_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20963096 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20963096 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03032025': {'nb_upload': 2, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340584307, 1340583079] Looping around the photos to save general results len do output : 1 /20963096Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340584307', None, None, None, None, None, '2628013') ('4234', None, None, None, None, None, None, None, '2628013') ('4234', '20963096', '1340583079', None, None, None, None, None, '2628013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012011528015136719 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8611953258514404 time spend to save output : 0.012179851531982422 total time spend for step 11 : 0.8733751773834229 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 49.45user 33.38system 3:45.61elapsed 36%CPU (0avgtext+0avgdata 5391072maxresident)k 709560inputs+18288outputs (225major+4379447minor)pagefaults 0swaps