python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2032542 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2799045'] with mtr_portfolio_ids : ['22729131'] and first list_photo_ids : [] new path : /proc/2032542/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 2.5335214138031006 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 6 21:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 21:10:33.250480: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 21:10:33.275189: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 21:10:33.276752: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd884000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 21:10:33.276808: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 21:10:33.279982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 21:10:33.582989: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x94bfa40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 21:10:33.583029: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 21:10:33.585597: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 21:10:33.585998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 21:10:33.588894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 21:10:33.591342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 21:10:33.591787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 21:10:33.594528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 21:10:33.595905: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 21:10:33.600257: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 21:10:33.601691: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 21:10:33.601757: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 21:10:33.602495: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 21:10:33.602511: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 21:10:33.602520: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 21:10:33.603885: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 21:10:33.857129: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 21:10:33.857250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 21:10:33.857271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 21:10:33.857290: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 21:10:33.857308: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 21:10:33.857327: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 21:10:33.857344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 21:10:33.857363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 21:10:33.858894: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 21:10:33.860269: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 21:10:33.860305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 21:10:33.860324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 21:10:33.860341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 21:10:33.860358: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 21:10:33.860375: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 21:10:33.860395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 21:10:33.860412: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 21:10:33.861927: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 21:10:33.861966: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 21:10:33.861976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 21:10:33.861986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 21:10:33.863591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/mod2025-05-06 21:10:44.461501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 21:10:44.669833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 51.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 17 Detection mask done ! Trying to reset tf kernel 2033397 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1748 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0004029273986816406 nb_pixel_total : 13527 time to create 1 rle with old method : 0.01527714729309082 length of segment : 119 time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 2971 time to create 1 rle with old method : 0.003314495086669922 length of segment : 132 time for calcul the mask position with numpy : 0.00018334388732910156 nb_pixel_total : 8722 time to create 1 rle with old method : 0.009863853454589844 length of segment : 190 time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 18268 time to create 1 rle with old method : 0.021390914916992188 length of segment : 156 time for calcul the mask position with numpy : 0.0014410018920898438 nb_pixel_total : 47470 time to create 1 rle with old method : 0.05438876152038574 length of segment : 258 time for calcul the mask position with numpy : 0.0004570484161376953 nb_pixel_total : 22528 time to create 1 rle with old method : 0.025846004486083984 length of segment : 189 time for calcul the mask position with numpy : 0.0014073848724365234 nb_pixel_total : 81026 time to create 1 rle with old method : 0.09018063545227051 length of segment : 343 time for calcul the mask position with numpy : 0.0002512931823730469 nb_pixel_total : 14135 time to create 1 rle with old method : 0.016748666763305664 length of segment : 130 time for calcul the mask position with numpy : 0.0002295970916748047 nb_pixel_total : 12663 time to create 1 rle with old method : 0.015082359313964844 length of segment : 97 time for calcul the mask position with numpy : 0.00031828880310058594 nb_pixel_total : 18213 time to create 1 rle with old method : 0.021029949188232422 length of segment : 142 time for calcul the mask position with numpy : 0.00018358230590820312 nb_pixel_total : 7758 time to create 1 rle with old method : 0.008944511413574219 length of segment : 128 time for calcul the mask position with numpy : 0.0004417896270751953 nb_pixel_total : 26587 time to create 1 rle with old method : 0.03115105628967285 length of segment : 213 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 14474 time to create 1 rle with old method : 0.01614832878112793 length of segment : 150 time for calcul the mask position with numpy : 0.00019788742065429688 nb_pixel_total : 9901 time to create 1 rle with old method : 0.011967182159423828 length of segment : 93 time for calcul the mask position with numpy : 0.0006618499755859375 nb_pixel_total : 29717 time to create 1 rle with old method : 0.03392791748046875 length of segment : 226 time for calcul the mask position with numpy : 0.00031185150146484375 nb_pixel_total : 14288 time to create 1 rle with old method : 0.016395092010498047 length of segment : 189 time for calcul the mask position with numpy : 0.0004363059997558594 nb_pixel_total : 15640 time to create 1 rle with old method : 0.017723798751831055 length of segment : 161 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 19250 time to create 1 rle with old method : 0.022162675857543945 length of segment : 181 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 9112 time to create 1 rle with old method : 0.010378122329711914 length of segment : 150 time for calcul the mask position with numpy : 0.0006034374237060547 nb_pixel_total : 23793 time to create 1 rle with old method : 0.031449079513549805 length of segment : 182 time for calcul the mask position with numpy : 0.0003578662872314453 nb_pixel_total : 12969 time to create 1 rle with old method : 0.0174715518951416 length of segment : 171 time for calcul the mask position with numpy : 0.0006604194641113281 nb_pixel_total : 29931 time to create 1 rle with old method : 0.03497743606567383 length of segment : 177 time for calcul the mask position with numpy : 0.0006926059722900391 nb_pixel_total : 33505 time to create 1 rle with old method : 0.03800559043884277 length of segment : 195 time for calcul the mask position with numpy : 0.00038242340087890625 nb_pixel_total : 15268 time to create 1 rle with old method : 0.01775646209716797 length of segment : 181 time for calcul the mask position with numpy : 0.0005543231964111328 nb_pixel_total : 21583 time to create 1 rle with old method : 0.024537324905395508 length of segment : 250 time for calcul the mask position with numpy : 0.00044226646423339844 nb_pixel_total : 16211 time to create 1 rle with old method : 0.018411874771118164 length of segment : 161 time for calcul the mask position with numpy : 0.0002892017364501953 nb_pixel_total : 11925 time to create 1 rle with old method : 0.013978958129882812 length of segment : 115 time for calcul the mask position with numpy : 0.0011739730834960938 nb_pixel_total : 44091 time to create 1 rle with old method : 0.050343990325927734 length of segment : 355 time for calcul the mask position with numpy : 0.0007188320159912109 nb_pixel_total : 36990 time to create 1 rle with old method : 0.042720794677734375 length of segment : 165 time for calcul the mask position with numpy : 0.00048804283142089844 nb_pixel_total : 18971 time to create 1 rle with old method : 0.021980762481689453 length of segment : 174 time for calcul the mask position with numpy : 0.0005142688751220703 nb_pixel_total : 24820 time to create 1 rle with old method : 0.028093814849853516 length of segment : 170 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 15677 time to create 1 rle with old method : 0.02585458755493164 length of segment : 151 time for calcul the mask position with numpy : 0.001093149185180664 nb_pixel_total : 35456 time to create 1 rle with old method : 0.04938817024230957 length of segment : 214 time for calcul the mask position with numpy : 0.0002579689025878906 nb_pixel_total : 9826 time to create 1 rle with old method : 0.011618614196777344 length of segment : 102 time for calcul the mask position with numpy : 0.0007822513580322266 nb_pixel_total : 28747 time to create 1 rle with old method : 0.0359959602355957 length of segment : 323 time for calcul the mask position with numpy : 0.0013208389282226562 nb_pixel_total : 27269 time to create 1 rle with old method : 0.04963064193725586 length of segment : 397 time for calcul the mask position with numpy : 0.0030183792114257812 nb_pixel_total : 49753 time to create 1 rle with old method : 0.07706928253173828 length of segment : 249 time for calcul the mask position with numpy : 0.0014166831970214844 nb_pixel_total : 44823 time to create 1 rle with old method : 0.053345680236816406 length of segment : 266 time for calcul the mask position with numpy : 0.0008411407470703125 nb_pixel_total : 22220 time to create 1 rle with old method : 0.026047706604003906 length of segment : 186 time for calcul the mask position with numpy : 0.002342700958251953 nb_pixel_total : 73924 time to create 1 rle with old method : 0.0858309268951416 length of segment : 425 time for calcul the mask position with numpy : 0.0004966259002685547 nb_pixel_total : 14247 time to create 1 rle with old method : 0.01615142822265625 length of segment : 154 time for calcul the mask position with numpy : 0.00021600723266601562 nb_pixel_total : 4649 time to create 1 rle with old method : 0.005409955978393555 length of segment : 91 time for calcul the mask position with numpy : 0.0016798973083496094 nb_pixel_total : 60251 time to create 1 rle with old method : 0.08299851417541504 length of segment : 287 time for calcul the mask position with numpy : 0.0003173351287841797 nb_pixel_total : 13594 time to create 1 rle with old method : 0.015791654586791992 length of segment : 136 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 15849 time to create 1 rle with old method : 0.01865673065185547 length of segment : 149 time for calcul the mask position with numpy : 0.0006897449493408203 nb_pixel_total : 19112 time to create 1 rle with old method : 0.023278474807739258 length of segment : 180 time for calcul the mask position with numpy : 0.0005013942718505859 nb_pixel_total : 20856 time to create 1 rle with old method : 0.024079084396362305 length of segment : 222 time for calcul the mask position with numpy : 0.0005459785461425781 nb_pixel_total : 31615 time to create 1 rle with old method : 0.04097557067871094 length of segment : 241 time for calcul the mask position with numpy : 0.0007784366607666016 nb_pixel_total : 25561 time to create 1 rle with old method : 0.02973651885986328 length of segment : 277 time for calcul the mask position with numpy : 0.0006465911865234375 nb_pixel_total : 16548 time to create 1 rle with old method : 0.019087553024291992 length of segment : 203 time for calcul the mask position with numpy : 0.00036215782165527344 nb_pixel_total : 9064 time to create 1 rle with old method : 0.010792255401611328 length of segment : 187 time for calcul the mask position with numpy : 0.000316619873046875 nb_pixel_total : 13984 time to create 1 rle with old method : 0.016510009765625 length of segment : 115 time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 13059 time to create 1 rle with old method : 0.014927864074707031 length of segment : 185 time for calcul the mask position with numpy : 0.0007190704345703125 nb_pixel_total : 35347 time to create 1 rle with old method : 0.04006195068359375 length of segment : 204 time for calcul the mask position with numpy : 0.0003542900085449219 nb_pixel_total : 10833 time to create 1 rle with old method : 0.012863874435424805 length of segment : 171 time for calcul the mask position with numpy : 0.0003848075866699219 nb_pixel_total : 18610 time to create 1 rle with old method : 0.021477699279785156 length of segment : 214 time for calcul the mask position with numpy : 0.00034499168395996094 nb_pixel_total : 13229 time to create 1 rle with old method : 0.015589237213134766 length of segment : 155 time for calcul the mask position with numpy : 0.0009069442749023438 nb_pixel_total : 46184 time to create 1 rle with old method : 0.05383706092834473 length of segment : 108 time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 19922 time to create 1 rle with old method : 0.02197575569152832 length of segment : 151 time for calcul the mask position with numpy : 0.0057146549224853516 nb_pixel_total : 231580 time to create 1 rle with new method : 0.017973899841308594 length of segment : 517 time for calcul the mask position with numpy : 0.0004723072052001953 nb_pixel_total : 17873 time to create 1 rle with old method : 0.020711898803710938 length of segment : 213 time for calcul the mask position with numpy : 0.0005726814270019531 nb_pixel_total : 26418 time to create 1 rle with old method : 0.04250478744506836 length of segment : 219 time for calcul the mask position with numpy : 0.0008606910705566406 nb_pixel_total : 27061 time to create 1 rle with time for calcul the mask position with numpy : 0.00043201446533203125 nb_pixel_total : 7549 time to create 1 rle with old method : 0.008765697479248047 length of segment : 103 time for calcul the mask position with numpy : 0.000583648681640625 nb_pixel_total : 19190 time to create 1 rle with old method : 0.021379709243774414 length of segment : 223 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 6083 time to create 1 rle with old method : 0.006874799728393555 length of segment : 71 time for calcul the mask position with numpy : 0.0004000663757324219 nb_pixel_total : 11916 time to create 1 rle with old method : 0.013422250747680664 length of segment : 108 time for calcul the mask position with numpy : 0.0014145374298095703 nb_pixel_total : 52141 time to create 1 rle with old method : 0.057036399841308594 length of segment : 288 time for calcul the mask position with numpy : 0.0006496906280517578 nb_pixel_total : 21536 time to create 1 rle with old method : 0.024783611297607422 length of segment : 170 time for calcul the mask position with numpy : 0.0008869171142578125 nb_pixel_total : 26354 time to create 1 rle with old method : 0.030684471130371094 length of segment : 284 time for calcul the mask position with numpy : 0.0034422874450683594 nb_pixel_total : 122938 time to create 1 rle with old method : 0.13476824760437012 length of segment : 348 time spent for convertir_results : 11.945003986358643 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 141 chid ids of type : 3594 Number RLEs to save : 31453 save missing photos in datou_result : time spend for datou_step_exec : 62.88634514808655 time spend to save output : 1.9192206859588623 total time spend for step 1 : 64.80556583404541 step2:crop_condition Tue May 6 21:11:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 141 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 100 About to insert : list_path_to_insert length 100 new photo from crops ! About to upload 100 photos upload in portfolio : 3736932 init cache_photo without model_param we have 100 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746558711_2032542 we have uploaded 100 photos in the portfolio 3736932 time of upload the photos Elapsed time : 31.657036542892456 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746558746_2032542 we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.309607744216919 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746558759_2032542 we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.766659736633301 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746558767_2032542 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9944112300872803 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746558769_2032542 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8716065883636475 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356381220, 1356380845, 1356380842, 1356380837, 1356380834, 1356380812, 1356380804, 1356380793] Looping around the photos to save general results len do output : 141 /1356436781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356436999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356437111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356381220', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380845', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380842', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380837', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380834', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380812', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380804', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380793', None, None, None, None, None, '2799045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 431 time used for this insertion : 0.06094169616699219 save_final save missing photos in datou_result : time spend for datou_step_exec : 74.83470749855042 time spend to save output : 0.06819987297058105 total time spend for step 2 : 74.902907371521 step3:rle_unique_nms_with_priority Tue May 6 21:12:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 141 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.370743751525879 time for calcul the mask position with numpy : 0.6452105045318604 nb_pixel_total : 6751997 time to create 1 rle with new method : 0.6293518543243408 time for calcul the mask position with numpy : 0.021427154541015625 nb_pixel_total : 9901 time to create 1 rle with old method : 0.010954856872558594 time for calcul the mask position with numpy : 0.0276181697845459 nb_pixel_total : 14474 time to create 1 rle with old method : 0.015807628631591797 time for calcul the mask position with numpy : 0.02115321159362793 nb_pixel_total : 26587 time to create 1 rle with old method : 0.029485225677490234 time for calcul the mask position with numpy : 0.022551298141479492 nb_pixel_total : 7758 time to create 1 rle with old method : 0.008668661117553711 time for calcul the mask position with numpy : 0.020795822143554688 nb_pixel_total : 18213 time to create 1 rle with old method : 0.019675254821777344 time for calcul the mask position with numpy : 0.021767616271972656 nb_pixel_total : 12663 time to create 1 rle with old method : 0.014070749282836914 time for calcul the mask position with numpy : 0.021623611450195312 nb_pixel_total : 14135 time to create 1 rle with old method : 0.015481233596801758 time for calcul the mask position with numpy : 0.022480487823486328 nb_pixel_total : 81026 time to create 1 rle with old method : 0.08897829055786133 time for calcul the mask position with numpy : 0.020462989807128906 nb_pixel_total : 22528 time to create 1 rle with old method : 0.024936199188232422 time for calcul the mask position with numpy : 0.023300886154174805 nb_pixel_total : 47470 time to create 1 rle with old method : 0.052498579025268555 time for calcul the mask position with numpy : 0.022271156311035156 nb_pixel_total : 18268 time to create 1 rle with old method : 0.02006673812866211 time for calcul the mask position with numpy : 0.02092456817626953 nb_pixel_total : 8722 time to create 1 rle with old method : 0.009688377380371094 time for calcul the mask position with numpy : 0.021146297454833984 nb_pixel_total : 2971 time to create 1 rle with old method : 0.003391265869140625 time for calcul the mask position with numpy : 0.10427308082580566 nb_pixel_total : 13527 time to create 1 rle with old method : 0.01638197898864746 create new chi : 2.0344691276550293 time to delete rle : 0.027531147003173828 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6840 TO DO : save crop sub photo not yet done ! save time : 0.47716379165649414 nb_obj : 20 nb_hashtags : 4 time to prepare the origin masks : 7.068185091018677 time for calcul the mask position with numpy : 0.41480112075805664 nb_pixel_total : 6611217 time to create 1 rle with new method : 1.0480296611785889 time for calcul the mask position with numpy : 0.03543710708618164 nb_pixel_total : 9826 time to create 1 rle with old method : 0.010888814926147461 time for calcul the mask position with numpy : 0.03468656539916992 nb_pixel_total : 35456 time to create 1 rle with old method : 0.0392458438873291 time for calcul the mask position with numpy : 0.028172969818115234 nb_pixel_total : 15677 time to create 1 rle with old method : 0.017578601837158203 time for calcul the mask position with numpy : 0.025645017623901367 nb_pixel_total : 24820 time to create 1 rle with old method : 0.04026460647583008 time for calcul the mask position with numpy : 0.02735161781311035 nb_pixel_total : 18971 time to create 1 rle with old method : 0.024947643280029297 time for calcul the mask position with numpy : 0.02254343032836914 nb_pixel_total : 36990 time to create 1 rle with old method : 0.041289329528808594 time for calcul the mask position with numpy : 0.02238917350769043 nb_pixel_total : 44091 time to create 1 rle with old method : 0.050794363021850586 time for calcul the mask position with numpy : 0.031624555587768555 nb_pixel_total : 11925 time to create 1 rle with old method : 0.013161897659301758 time for calcul the mask position with numpy : 0.02199530601501465 nb_pixel_total : 16211 time to create 1 rle with old method : 0.0179598331451416 time for calcul the mask position with numpy : 0.021796226501464844 nb_pixel_total : 21583 time to create 1 rle with old method : 0.023220300674438477 time for calcul the mask position with numpy : 0.021703720092773438 nb_pixel_total : 15268 time to create 1 rle with old method : 0.016837596893310547 time for calcul the mask position with numpy : 0.02173924446105957 nb_pixel_total : 33505 time to create 1 rle with old method : 0.036373138427734375 time for calcul the mask position with numpy : 0.02431797981262207 nb_pixel_total : 29931 time to create 1 rle with old method : 0.047441959381103516 time for calcul the mask position with numpy : 0.023768901824951172 nb_pixel_total : 12969 time to create 1 rle with old method : 0.018811941146850586 time for calcul the mask position with numpy : 0.02254009246826172 nb_pixel_total : 23793 time to create 1 rle with old method : 0.029245615005493164 time for calcul the mask position with numpy : 0.022375106811523438 nb_pixel_total : 9112 time to create 1 rle with old method : 0.010227203369140625 time for calcul the mask position with numpy : 0.022588014602661133 nb_pixel_total : 19250 time to create 1 rle with old method : 0.02111339569091797 time for calcul the mask position with numpy : 0.021384239196777344 nb_pixel_total : 15640 time to create 1 rle with old method : 0.01723957061767578 time for calcul the mask position with numpy : 0.021752357482910156 nb_pixel_total : 14288 time to create 1 rle with old method : 0.015860795974731445 time for calcul the mask position with numpy : 0.022707462310791016 nb_pixel_total : 29717 time to create 1 rle with old method : 0.03298473358154297 create new chi : 2.5239975452423096 time to delete rle : 0.0017926692962646484 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 9500 TO DO : save crop sub photo not yet done ! save time : 0.5829036235809326 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 6.701708078384399 time for calcul the mask position with numpy : 0.6310720443725586 nb_pixel_total : 6498935 time to create 1 rle with new method : 0.3723323345184326 time for calcul the mask position with numpy : 0.02116250991821289 nb_pixel_total : 10833 time to create 1 rle with old method : 0.013979911804199219 time for calcul the mask position with numpy : 0.020479202270507812 nb_pixel_total : 35347 time to create 1 rle with old method : 0.03870248794555664 time for calcul the mask position with numpy : 0.020483970642089844 nb_pixel_total : 13059 time to create 1 rle with old method : 0.014328479766845703 time for calcul the mask position with numpy : 0.020315885543823242 nb_pixel_total : 13984 time to create 1 rle with old method : 0.015387773513793945 time for calcul the mask position with numpy : 0.021003246307373047 nb_pixel_total : 9064 time to create 1 rle with old method : 0.00991964340209961 time for calcul the mask position with numpy : 0.021455049514770508 nb_pixel_total : 16548 time to create 1 rle with old method : 0.01851654052734375 time for calcul the mask position with numpy : 0.021828174591064453 nb_pixel_total : 25561 time to create 1 rle with old method : 0.028478384017944336 time for calcul the mask position with numpy : 0.02056884765625 nb_pixel_total : 31615 time to create 1 rle with old method : 0.03502821922302246 time for calcul the mask position with numpy : 0.02025318145751953 nb_pixel_total : 20856 time to create 1 rle with old method : 0.029520273208618164 time for calcul the mask position with numpy : 0.023633241653442383 nb_pixel_total : 19112 time to create 1 rle with old method : 0.031479835510253906 time for calcul the mask position with numpy : 0.023584604263305664 nb_pixel_total : 15849 time to create 1 rle with old method : 0.01811838150024414 time for calcul the mask position with numpy : 0.021687746047973633 nb_pixel_total : 13594 time to create 1 rle with old method : 0.01519012451171875 time for calcul the mask position with numpy : 0.02190089225769043 nb_pixel_total : 60251 time to create 1 rle with old method : 0.0641164779663086 time for calcul the mask position with numpy : 0.02029728889465332 nb_pixel_total : 4649 time to create 1 rle with old method : 0.0050220489501953125 time for calcul the mask position with numpy : 0.02155137062072754 nb_pixel_total : 14247 time to create 1 rle with old method : 0.015765666961669922 time for calcul the mask position with numpy : 0.02245187759399414 nb_pixel_total : 73924 time to create 1 rle with old method : 0.08426356315612793 time for calcul the mask position with numpy : 0.028057575225830078 nb_pixel_total : 22220 time to create 1 rle with old method : 0.031052112579345703 time for calcul the mask position with numpy : 0.0245819091796875 nb_pixel_total : 44823 time to create 1 rle with old method : 0.050988197326660156 time for calcul the mask position with numpy : 0.022598981857299805 nb_pixel_total : 49753 time to create 1 rle with old method : 0.05589747428894043 time for calcul the mask position with numpy : 0.022852420806884766 nb_pixel_total : 27269 time to create 1 rle with old method : 0.0326695442199707 time for calcul the mask position with numpy : 0.0230255126953125 nb_pixel_total : 28747 time to create 1 rle with old method : 0.03174233436584473 create new chi : 2.148247241973877 time to delete rle : 0.0015087127685546875 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 11456 TO DO : save crop sub photo not yet done ! save time : 0.7059669494628906 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 6.489503860473633 time for calcul the mask position with numpy : 0.42130136489868164 nb_pixel_total : 6300205 time to create 1 rle with new method : 0.7834882736206055 time for calcul the mask position with numpy : 0.022622108459472656 nb_pixel_total : 65326 time to create 1 rle with old method : 0.07409787178039551 time for calcul the mask position with numpy : 0.022177457809448242 nb_pixel_total : 2885 time to create 1 rle with old method : 0.003415346145629883 time for calcul the mask position with numpy : 0.02214217185974121 nb_pixel_total : 41007 time to create 1 rle with old method : 0.04587197303771973 time for calcul the mask position with numpy : 0.024439573287963867 nb_pixel_total : 13761 time to create 1 rle with old method : 0.022605180740356445 time for calcul the mask position with numpy : 0.022526979446411133 nb_pixel_total : 6823 time to create 1 rle with old method : 0.007683753967285156 time for calcul the mask position with numpy : 0.021965742111206055 nb_pixel_total : 68265 time to create 1 rle with old method : 0.07631802558898926 time for calcul the mask position with numpy : 0.024341583251953125 nb_pixel_total : 55313 time to create 1 rle with old method : 0.07661175727844238 time for calcul the mask position with numpy : 0.023915529251098633 nb_pixel_total : 32347 time to create 1 rle with old method : 0.036388397216796875 time for calcul the mask position with numpy : 0.024766921997070312 nb_pixel_total : 6465 time to create 1 rle with old method : 0.0074198246002197266 time for calcul the mask position with numpy : 0.026158571243286133 nb_pixel_total : 8941 time to create 1 rle with old method : 0.009966850280761719 time for calcul the mask position with numpy : 0.022661685943603516 nb_pixel_total : 36280 time to create 1 rle with old method : 0.04102659225463867 time for calcul the mask position with numpy : 0.022913217544555664 nb_pixel_total : 11745 time to create 1 rle with old method : 0.018612146377563477 time for calcul the mask position with numpy : 0.027062416076660156 nb_pixel_total : 27061 time to create 1 rle with old method : 0.052213430404663086 time for calcul the mask position with numpy : 0.028308391571044922 nb_pixel_total : 26418 time to create 1 rle with old method : 0.04426074028015137 time for calcul the mask position with numpy : 0.022457599639892578 nb_pixel_total : 17873 time to create 1 rle with old method : 0.019483566284179688 time for calcul the mask position with numpy : 0.02249598503112793 nb_pixel_total : 231580 time to create 1 rle with new method : 0.755115270614624 time for calcul the mask position with numpy : 0.023874998092651367 nb_pixel_total : 19922 time to create 1 rle with old method : 0.024812698364257812 time for calcul the mask position with numpy : 0.02661871910095215 nb_pixel_total : 46184 time to create 1 rle with old method : 0.06687784194946289 time for calcul the mask position with numpy : 0.0212705135345459 nb_pixel_total : 13229 time to create 1 rle with old method : 0.014694452285766602 time for calcul the mask position with numpy : 0.02170729637145996 nb_pixel_total : 18610 time to create 1 rle with old method : 0.02297377586364746 create new chi : 3.164621591567993 time to delete rle : 0.0026106834411621094 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 11122 TO DO : save crop sub photo not yet done ! save time : 0.7221860885620117 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 8.864608764648438 time for calcul the mask position with numpy : 0.5781712532043457 nb_pixel_total : 6076043 time to create 1 rle with new method : 0.6409826278686523 time for calcul the mask position with numpy : 0.02200031280517578 nb_pixel_total : 98605 time to create 1 rle with old method : 0.1088724136352539 time for calcul the mask position with numpy : 0.025330543518066406 nb_pixel_total : 85043 time to create 1 rle with old method : 0.09215974807739258 time for calcul the mask position with numpy : 0.024090051651000977 nb_pixel_total : 303890 time to create 1 rle with new method : 0.581845760345459 time for calcul the mask position with numpy : 0.021274328231811523 nb_pixel_total : 16487 time to create 1 rle with old method : 0.018143177032470703 time for calcul the mask position with numpy : 0.020905733108520508 nb_pixel_total : 8295 time to create 1 rle with old method : 0.009330511093139648 time for calcul the mask position with numpy : 0.021295547485351562 nb_pixel_total : 13095 time to create 1 rle with old method : 0.014650583267211914 time for calcul the mask position with numpy : 0.021603822708129883 nb_pixel_total : 26344 time to create 1 rle with old method : 0.02877044677734375 time for calcul the mask position with numpy : 0.033812761306762695 nb_pixel_total : 20614 time to create 1 rle with old method : 0.023065567016601562 time for calcul the mask position with numpy : 0.034734487533569336 nb_pixel_total : 31604 time to create 1 rle with old method : 0.03432273864746094 time for calcul the mask position with numpy : 0.03416037559509277 nb_pixel_total : 95458 time to create 1 rle with old method : 0.10472893714904785 time for calcul the mask position with numpy : 0.0333712100982666 nb_pixel_total : 13938 time to create 1 rle with old method : 0.014850616455078125 time for calcul the mask position with numpy : 0.033722639083862305 nb_pixel_total : 68601 time to create 1 rle with old method : 0.07573676109313965 time for calcul the mask position with numpy : 0.032282114028930664 nb_pixel_total : 11420 time to create 1 rle with old method : 0.012312889099121094 time for calcul the mask position with numpy : 0.035242319107055664 nb_pixel_total : 31150 time to create 1 rle with old method : 0.03417372703552246 time for calcul the mask position with numpy : 0.034300804138183594 nb_pixel_total : 15694 time to create 1 rle with old method : 0.017116308212280273 time for calcul the mask position with numpy : 0.03798842430114746 nb_pixel_total : 15629 time to create 1 rle with old method : 0.01729607582092285 time for calcul the mask position with numpy : 0.034848928451538086 nb_pixel_total : 50675 time to create 1 rle with old method : 0.05577588081359863 time for calcul the mask position with numpy : 0.03854727745056152 nb_pixel_total : 15627 time to create 1 rle with old method : 0.017554283142089844 time for calcul the mask position with numpy : 0.03486156463623047 nb_pixel_total : 29126 time to create 1 rle with old method : 0.032332658767700195 time for calcul the mask position with numpy : 0.025882244110107422 nb_pixel_total : 5085 time to create 1 rle with old method : 0.0056188106536865234 time for calcul the mask position with numpy : 0.02178645133972168 nb_pixel_total : 17817 time to create 1 rle with old method : 0.01955389976501465 create new chi : 3.2224276065826416 time to delete rle : 0.0016999244689941406 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 12504 TO DO : save crop sub photo not yet done ! save time : 0.771930456161499 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 6.716471433639526 time for calcul the mask position with numpy : 0.6795628070831299 nb_pixel_total : 6204874 time to create 1 rle with new method : 0.7412314414978027 time for calcul the mask position with numpy : 0.035541534423828125 nb_pixel_total : 18509 time to create 1 rle with old method : 0.020865201950073242 time for calcul the mask position with numpy : 0.03740382194519043 nb_pixel_total : 18762 time to create 1 rle with old method : 0.02107524871826172 time for calcul the mask position with numpy : 0.03611302375793457 nb_pixel_total : 28206 time to create 1 rle with old method : 0.030638694763183594 time for calcul the mask position with numpy : 0.03365683555603027 nb_pixel_total : 12799 time to create 1 rle with old method : 0.014009475708007812 time for calcul the mask position with numpy : 0.033423662185668945 nb_pixel_total : 31318 time to create 1 rle with old method : 0.03409910202026367 time for calcul the mask position with numpy : 0.03481793403625488 nb_pixel_total : 32204 time to create 1 rle with old method : 0.03622555732727051 time for calcul the mask position with numpy : 0.027753591537475586 nb_pixel_total : 7727 time to create 1 rle with old method : 0.008800745010375977 time for calcul the mask position with numpy : 0.023360013961791992 nb_pixel_total : 35774 time to create 1 rle with old method : 0.04051661491394043 time for calcul the mask position with numpy : 0.02174091339111328 nb_pixel_total : 10187 time to create 1 rle with old method : 0.011397123336791992 time for calcul the mask position with numpy : 0.02232074737548828 nb_pixel_total : 52960 time to create 1 rle with old method : 0.05882763862609863 time for calcul the mask position with numpy : 0.02195453643798828 nb_pixel_total : 17857 time to create 1 rle with old method : 0.019553184509277344 time for calcul the mask position with numpy : 0.021943092346191406 nb_pixel_total : 38128 time to create 1 rle with old method : 0.04042196273803711 time for calcul the mask position with numpy : 0.021277666091918945 nb_pixel_total : 44390 time to create 1 rle with old method : 0.04611015319824219 time for calcul the mask position with numpy : 0.020797014236450195 nb_pixel_total : 27221 time to create 1 rle with old method : 0.02903270721435547 time for calcul the mask position with numpy : 0.021213054656982422 nb_pixel_total : 22923 time to create 1 rle with old method : 0.02493119239807129 time for calcul the mask position with numpy : 0.021574974060058594 nb_pixel_total : 57786 time to create 1 rle with old method : 0.062413930892944336 time for calcul the mask position with numpy : 0.026500225067138672 nb_pixel_total : 356093 time to create 1 rle with new method : 0.47794556617736816 time for calcul the mask position with numpy : 0.02208566665649414 nb_pixel_total : 9072 time to create 1 rle with old method : 0.009820222854614258 time for calcul the mask position with numpy : 0.021923303604125977 nb_pixel_total : 23450 time to create 1 rle with old method : 0.02562737464904785 create new chi : 3.001120090484619 time to delete rle : 0.00249481201171875 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 11414 TO DO : save crop sub photo not yet done ! save time : 0.6994585990905762 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 6.171266555786133 time for calcul the mask position with numpy : 0.5400955677032471 nb_pixel_total : 6214233 time to create 1 rle with new method : 0.7585783004760742 time for calcul the mask position with numpy : 0.033776044845581055 nb_pixel_total : 20910 time to create 1 rle with old method : 0.0226442813873291 time for calcul the mask position with numpy : 0.020815610885620117 nb_pixel_total : 7254 time to create 1 rle with old method : 0.008195638656616211 time for calcul the mask position with numpy : 0.02217411994934082 nb_pixel_total : 20053 time to create 1 rle with old method : 0.022424936294555664 time for calcul the mask position with numpy : 0.023250341415405273 nb_pixel_total : 7246 time to create 1 rle with old method : 0.008282899856567383 time for calcul the mask position with numpy : 0.02318572998046875 nb_pixel_total : 70313 time to create 1 rle with old method : 0.07583999633789062 time for calcul the mask position with numpy : 0.022253036499023438 nb_pixel_total : 11883 time to create 1 rle with old method : 0.019350290298461914 time for calcul the mask position with numpy : 0.022457361221313477 nb_pixel_total : 51104 time to create 1 rle with old method : 0.06717181205749512 time for calcul the mask position with numpy : 0.026389360427856445 nb_pixel_total : 18084 time to create 1 rle with old method : 0.02049541473388672 time for calcul the mask position with numpy : 0.02856922149658203 nb_pixel_total : 98194 time to create 1 rle with old method : 0.10895562171936035 time for calcul the mask position with numpy : 0.023819684982299805 nb_pixel_total : 59541 time to create 1 rle with old method : 0.0654604434967041 time for calcul the mask position with numpy : 0.021677017211914062 nb_pixel_total : 129414 time to create 1 rle with old method : 0.1400618553161621 time for calcul the mask position with numpy : 0.02251148223876953 nb_pixel_total : 24027 time to create 1 rle with old method : 0.025487422943115234 time for calcul the mask position with numpy : 0.022150516510009766 nb_pixel_total : 27582 time to create 1 rle with old method : 0.030054807662963867 time for calcul the mask position with numpy : 0.02128148078918457 nb_pixel_total : 27122 time to create 1 rle with old method : 0.028850078582763672 time for calcul the mask position with numpy : 0.022687911987304688 nb_pixel_total : 204183 time to create 1 rle with new method : 0.4608936309814453 time for calcul the mask position with numpy : 0.021527767181396484 nb_pixel_total : 59097 time to create 1 rle with old method : 0.06370162963867188 create new chi : 2.907585620880127 time to delete rle : 0.002836465835571289 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 11359 TO DO : save crop sub photo not yet done ! save time : 0.7719457149505615 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.20955228805542 time for calcul the mask position with numpy : 1.1886656284332275 nb_pixel_total : 6754297 time to create 1 rle with new method : 0.6406562328338623 time for calcul the mask position with numpy : 0.02328348159790039 nb_pixel_total : 122938 time to create 1 rle with old method : 0.13661861419677734 time for calcul the mask position with numpy : 0.02213120460510254 nb_pixel_total : 26354 time to create 1 rle with old method : 0.029403209686279297 time for calcul the mask position with numpy : 0.024164438247680664 nb_pixel_total : 21277 time to create 1 rle with old method : 0.02409076690673828 time for calcul the mask position with numpy : 0.026227712631225586 nb_pixel_total : 52141 time to create 1 rle with old method : 0.059705257415771484 time for calcul the mask position with numpy : 0.023842811584472656 nb_pixel_total : 11916 time to create 1 rle with old method : 0.013673782348632812 time for calcul the mask position with numpy : 0.02071857452392578 nb_pixel_total : 6083 time to create 1 rle with old method : 0.006695747375488281 time for calcul the mask position with numpy : 0.02224564552307129 nb_pixel_total : 19190 time to create 1 rle with old method : 0.03195929527282715 time for calcul the mask position with numpy : 0.023623228073120117 nb_pixel_total : 7549 time to create 1 rle with old method : 0.012743949890136719 time for calcul the mask position with numpy : 0.02280139923095703 nb_pixel_total : 15720 time to create 1 rle with old method : 0.017440080642700195 time for calcul the mask position with numpy : 0.0209505558013916 nb_pixel_total : 12775 time to create 1 rle with old method : 0.014490842819213867 create new chi : 2.4469709396362305 time to delete rle : 0.0009272098541259766 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 5838 TO DO : save crop sub photo not yet done ! save time : 0.389739990234375 map_output_result : {1356381220: (0.0, 'Should be the crop_list due to order', 0), 1356380845: (0.0, 'Should be the crop_list due to order', 0), 1356380842: (0.0, 'Should be the crop_list due to order', 0), 1356380837: (0.0, 'Should be the crop_list due to order', 0), 1356380834: (0.0, 'Should be the crop_list due to order', 0), 1356380812: (0.0, 'Should be the crop_list due to order', 0), 1356380804: (0.0, 'Should be the crop_list due to order', 0), 1356380793: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356381220, 1356380845, 1356380842, 1356380837, 1356380834, 1356380812, 1356380804, 1356380793] Looping around the photos to save general results len do output : 8 /1356381220.Didn't retrieve data . /1356380845.Didn't retrieve data . /1356380842.Didn't retrieve data . /1356380837.Didn't retrieve data . /1356380834.Didn't retrieve data . /1356380812.Didn't retrieve data . /1356380804.Didn't retrieve data . /1356380793.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356381220', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380845', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380842', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380837', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380834', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380812', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380804', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380793', None, None, None, None, None, '2799045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015758752822875977 save_final save missing photos in datou_result : time spend for datou_step_exec : 80.26720118522644 time spend to save output : 0.0161895751953125 total time spend for step 3 : 80.28339076042175 step4:ventilate_hashtags_in_portfolio Tue May 6 21:14:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22729131 get user id for portfolio 22729131 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22729131 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_fonce','flou','papier','mal_croppe','metal','background','pehd','carton','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22729131 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_fonce','flou','papier','mal_croppe','metal','background','pehd','carton','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22729131 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_fonce','flou','papier','mal_croppe','metal','background','pehd','carton','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22729942,22729943,22729944,22729945,22729946,22729947,22729948,22729949,22729950,22729951,22729952?tags=environnement,pet_fonce,flou,papier,mal_croppe,metal,background,pehd,carton,pet_clair,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356381220, 1356380845, 1356380842, 1356380837, 1356380834, 1356380812, 1356380804, 1356380793] Looping around the photos to save general results len do output : 1 /22729131. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356381220', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380845', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380842', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380837', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380834', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380812', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380804', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380793', None, None, None, None, None, '2799045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014861345291137695 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.628922939300537 time spend to save output : 0.015239715576171875 total time spend for step 4 : 1.644162654876709 step5:final Tue May 6 21:14:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356381220: ('0.08847427534381808',), 1356380845: ('0.08847427534381808',), 1356380842: ('0.08847427534381808',), 1356380837: ('0.08847427534381808',), 1356380834: ('0.08847427534381808',), 1356380812: ('0.08847427534381808',), 1356380804: ('0.08847427534381808',), 1356380793: ('0.08847427534381808',)} new output for save of step final : {1356381220: ('0.08847427534381808',), 1356380845: ('0.08847427534381808',), 1356380842: ('0.08847427534381808',), 1356380837: ('0.08847427534381808',), 1356380834: ('0.08847427534381808',), 1356380812: ('0.08847427534381808',), 1356380804: ('0.08847427534381808',), 1356380793: ('0.08847427534381808',)} [1356381220, 1356380845, 1356380842, 1356380837, 1356380834, 1356380812, 1356380804, 1356380793] Looping around the photos to save general results len do output : 8 /1356381220.Didn't retrieve data . /1356380845.Didn't retrieve data . /1356380842.Didn't retrieve data . /1356380837.Didn't retrieve data . /1356380834.Didn't retrieve data . /1356380812.Didn't retrieve data . /1356380804.Didn't retrieve data . /1356380793.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356381220', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380845', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380842', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380837', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380834', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380812', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380804', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380793', None, None, None, None, None, '2799045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013657808303833008 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11556363105773926 time spend to save output : 0.014132261276245117 total time spend for step 5 : 0.12969589233398438 step6:blur_detection Tue May 6 21:14:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda.jpg resize: (2160, 3264) 1356381220 -1.5305888343455205 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2.jpg resize: (2160, 3264) 1356380845 -1.9145305392698397 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b.jpg resize: (2160, 3264) 1356380842 -2.316296282970996 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836.jpg resize: (2160, 3264) 1356380837 -2.2752193315222056 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2.jpg resize: (2160, 3264) 1356380834 1.6607775844471988 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7.jpg resize: (2160, 3264) 1356380812 -2.084591590101297 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0.jpg resize: (2160, 3264) 1356380804 -2.0469770966473204 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15.jpg resize: (2160, 3264) 1356380793 -0.6787152431983611 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965177_0.png resize: (117, 161) 1356436781 -0.1199430169738699 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965178_0.png resize: (130, 34) 1356436783 -0.6386065519916335 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965179_0.png resize: (189, 62) 1356436784 -1.0847066936408305 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965180_0.png resize: (130, 200) 1356436786 -0.25684124768851163 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965181_0.png resize: (243, 306) 1356436787 -1.0826555037459338 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965182_0.png resize: (189, 207) 1356436788 -0.9262737367915935 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965184_0.png resize: (130, 167) 1356436791 -0.03975381114004533 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965185_0.png resize: (96, 190) 1356436792 -0.5364183910086299 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965186_0.png resize: (138, 188) 1356436793 -0.7527909279613655 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965187_0.png resize: (128, 78) 1356436794 -0.03716021088959703 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965189_0.png resize: (150, 133) 1356436796 -0.18032681239087445 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965190_0.png resize: (90, 155) 1356436797 -0.6705353932811371 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965191_0.png resize: (226, 195) 1356436798 -0.07813171623321986 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965192_0.png resize: (189, 111) 1356436800 -0.4067573863937082 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965193_0.png resize: (160, 131) 1356436801 -1.1524631906684621 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965194_0.png resize: (149, 211) 1356436802 -1.2954556290596506 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965195_0.png resize: (149, 98) 1356436803 -1.3815074194071255 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965196_0.png resize: (179, 227) 1356436805 -1.067740165600381 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965197_0.png resize: (171, 119) 1356436806 -0.5938746932023302 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965201_0.png resize: (232, 201) 1356436807 -2.2686579267455347 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965202_0.png resize: (159, 168) 1356436809 -1.1761169107317755 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965203_0.png resize: (110, 148) 1356436810 -0.9354045102911525 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965206_0.png resize: (172, 156) 1356436811 -0.6585830882070051 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965207_0.png resize: (170, 215) 1356436813 -1.4717294572209625 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965209_0.png resize: (214, 310) 1356436814 -1.1078784249667037 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965210_0.png resize: (102, 127) 1356436815 -0.17270537368000485 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965211_0.png resize: (321, 142) 1356436816 -2.324445332713923 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965212_0.png resize: (289, 169) 1356436818 -2.294224194348844 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965213_0.png resize: (216, 345) 1356436819 -0.7840779888588725 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965216_0.png resize: (405, 348) 1356436820 -1.8471955226295942 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965217_0.png resize: (152, 150) 1356436822 -3.220529393127544 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965218_0.png resize: (91, 74) 1356436823 -1.4537624450697082 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965221_0.png resize: (148, 170) 1356436824 -1.377518070349973 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965222_0.png resize: (177, 192) 1356436825 -1.5583776301895358 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965224_0.png resize: (227, 161) 1356436827 0.1470550387213186 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965226_0.png resize: (203, 127) 1356436828 -1.391249279805858 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965227_0.png resize: (193, 127) 1356436829 -1.985981396665086 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965228_0.png resize: (115, 147) 1356436831 -0.5723492031688896 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965230_0.png resize: (188, 277) 1356436832 -0.9203660648482492 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965231_0.png resize: (151, 99) 1356436833 -1.3131539059070048 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965232_0.png resize: (214, 108) 1356436835 -0.5362105922301778 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965233_0.png resize: (154, 136) 1356436836 -1.2833348227048842 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965234_0.png resize: (94, 667) 1356436837 -1.238129002991626 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965235_0.png resize: (148, 183) 1356436839 -0.9660281779628037 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965237_0.png resize: (213, 130) 1356436840 -0.04631238557942922 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965238_0.png resize: (219, 188) 1356436841 -0.7700834873959366 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965239_0.png resize: (171, 229) 1356436842 -1.056001824283426 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965240_0.png resize: (155, 103) 1356436844 -2.2525850919281623 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965241_0.png resize: (225, 216) 1356436846 -1.7788337246433785 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965242_0.png resize: (97, 111) 1356436847 -0.04042536398734781 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965243_0.png resize: (106, 103) 1356436848 -2.804307210487724 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965244_0.png resize: (182, 254) 1356436850 -2.2638377419849207 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965245_0.png resize: (449, 168) 1356436852 -3.4744900682091475 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965246_0.png resize: (384, 356) 1356436853 -2.217060878069316 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965247_0.png resize: (89, 103) 1356436855 -0.05553188515031302 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965248_0.png resize: (145, 167) 1356436856 -2.0067156305630833 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965250_0.png resize: (88, 126) 1356436857 -2.397284380936659 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965251_0.png resize: (263, 314) 1356436859 -0.6638972583293363 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965252_0.png resize: (140, 160) 1356436860 1.007286752943927 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965253_0.png resize: (88, 110) 1356436861 -0.29363118580243247 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965254_0.png resize: (134, 276) 1356436862 0.04441341057622727 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965257_0.png resize: (141, 132) 1356436864 1.6060820224331156 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965259_0.png resize: (190, 243) 1356436865 -0.3583158259205422 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965260_0.png resize: (107, 158) 1356436866 -0.5503281489358315 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965262_0.png resize: (174, 112) 1356436868 -1.558963102112619 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965264_0.png resize: (223, 200) 1356436869 -1.2464758075292304 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965266_0.png resize: (257, 231) 1356436870 -1.82050257232818 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965273_0.png resize: (170, 264) 1356436871 -1.8800178374462855 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965274_0.png resize: (115, 107) 1356436873 -0.7557168482877541 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965275_0.png resize: (745, 599) 1356436874 -0.3335291533524994 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965276_0.png resize: (250, 363) 1356436875 -1.314117121919574 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965277_0.png resize: (214, 146) 1356436877 -0.20342864111698508 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965279_0.png resize: (285, 201) 1356436878 -0.44109935659951827 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965280_0.png resize: (250, 288) 1356436879 -0.8529725546713591 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965281_0.png resize: (207, 166) 1356436881 -0.9394206860125829 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965282_0.png resize: (369, 216) 1356436882 -2.5538068101803253 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965283_0.png resize: (121, 132) 1356436883 -0.29668350444916247 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965284_0.png resize: (243, 236) 1356436884 -2.0186101392090703 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965285_0.png resize: (105, 90) 1356436886 0.2390120208449699 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965286_0.png resize: (224, 266) 1356436887 -0.9766550077030384 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965287_0.png resize: (177, 192) 1356436889 -0.6088448336746775 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965288_0.png resize: (159, 137) 1356436891 -0.629418147804655 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965289_0.png resize: (210, 212) 1356436892 -0.4004457929445023 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965291_0.png resize: (175, 157) 1356436893 -1.4712052234931947 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965292_0.png resize: (326, 269) 1356436894 -0.4468018187031585 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965293_0.png resize: (486, 632) 1356436896 -1.4431172128051295 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965295_0.png resize: (274, 202) 1356436897 -1.8823466859757318 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965296_0.png resize: (251, 204) 1356436898 -1.2868281337670617 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965299_0.png resize: (367, 423) 1356436900 -1.9258610308662267 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965301_0.png resize: (193, 427) 1356436901 -1.8566448997399327 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965302_0.png resize: (113, 143) 1356436902 -0.8786466022300694 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965303_0.png resize: (298, 351) 1356436905 -1.5154453807948953 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965307_0.png resize: (342, 141) 1356436906 -2.2598201872533106 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965308_0.png resize: (132, 160) 1356436907 -0.2689874892017655 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965309_0.png resize: (123, 208) 1356436908 -0.32210496420151075 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965310_0.png resize: (103, 113) 1356436910 -0.6755984680660175 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965311_0.png resize: (223, 118) 1356436911 -0.7612770706226059 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965312_0.png resize: (71, 101) 1356436912 2.145546562998638 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965313_0.png resize: (108, 141) 1356436914 1.2007183147688107 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965317_0.png resize: (340, 596) 1356436915 -0.7034951149695395 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965188_0.png resize: (213, 170) 1356436981 -1.1005272722352357 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965198_0.png resize: (173, 251) 1356436982 -0.5079102266538639 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965200_0.png resize: (181, 153) 1356436983 -1.069224848202894 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965205_0.png resize: (154, 289) 1356436984 -0.4072988305033463 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965214_0.png resize: (205, 409) 1356436985 -1.982453062177888 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965223_0.png resize: (222, 169) 1356436986 -2.2611126769376897 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965225_0.png resize: (240, 217) 1356436987 -1.7383145761491483 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965229_0.png resize: (185, 90) 1356436989 0.3153977652930157 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965265_0.png resize: (153, 172) 1356436990 0.3176491070871826 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965278_0.png resize: (161, 219) 1356436992 0.014764633971429512 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965294_0.png resize: (229, 187) 1356436993 -0.929177038040693 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965300_0.png resize: (160, 231) 1356436994 -1.6170617252998065 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965304_0.png resize: (152, 114) 1356436995 -2.199822197632269 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965305_0.png resize: (243, 201) 1356436996 -1.70793574407859 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965306_0.png resize: (139, 149) 1356436997 -0.6863477340071737 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965315_0.png resize: (142, 253) 1356436998 -0.6217693361960105 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965316_0.png resize: (234, 179) 1356436999 -1.4919890933840314 treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965183_0.png resize: (315, 319) 1356437055 -1.267060477959979 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965204_0.png resize: (345, 194) 1356437056 -1.7958593552875766 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965215_0.png resize: (186, 189) 1356437057 -1.9686148464786741 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965219_0.png resize: (225, 398) 1356437058 -2.3921785060511898 treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965220_0.png resize: (135, 128) 1356437059 -2.2709547038119338 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965236_0.png resize: (515, 602) 1356437060 -1.779704624841051 treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965249_0.png resize: (186, 288) 1356437061 -2.753923869234069 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965255_0.png resize: (197, 153) 1356437062 -1.6603510371881596 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965256_0.png resize: (272, 279) 1356437063 -1.7754693275831341 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965258_0.png resize: (145, 162) 1356437064 -0.5388476488059467 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965261_0.png resize: (207, 438) 1356437065 -1.2969787490253142 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965263_0.png resize: (304, 394) 1356437066 -0.16181522556325012 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965267_0.png resize: (172, 163) 1356437067 -3.519090351516489 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965268_0.png resize: (113, 141) 1356437068 -2.342931842418655 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965269_0.png resize: (183, 128) 1356437069 0.28286705346315993 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965270_0.png resize: (762, 703) 1356437070 -0.17285123486564216 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965271_0.png resize: (343, 394) 1356437071 0.2819566748666521 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965298_0.png resize: (416, 206) 1356437072 -3.324953355905144 treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965314_0.png resize: (278, 269) 1356437073 -3.2087814375801345 treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965272_0.png resize: (336, 353) 1356437091 0.7106486397482678 treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965290_0.png resize: (170, 217) 1356437093 -1.098313527286528 treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965297_0.png resize: (391, 405) 1356437094 0.3873564741654123 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965199_0.png resize: (195, 208) 1356437110 1.3438783664117238 treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965208_0.png resize: (151, 139) 1356437111 -0.7574049582212873 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 149 time used for this insertion : 0.018317699432373047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 149 time used for this insertion : 0.030620574951171875 save missing photos in datou_result : time spend for datou_step_exec : 29.51064944267273 time spend to save output : 0.054997920989990234 total time spend for step 6 : 29.56564736366272 step7:brightness Tue May 6 21:14:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda.jpg treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2.jpg treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b.jpg treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836.jpg treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2.jpg treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7.jpg treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0.jpg treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15.jpg treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965177_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965178_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965179_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965180_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965181_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965182_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965184_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965185_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965186_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965187_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965189_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965190_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965191_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965192_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965193_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965194_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965195_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965196_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965197_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965201_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965202_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965203_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965206_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965207_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965209_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965210_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965211_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965212_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965213_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965216_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965217_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965218_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965221_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965222_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965224_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965226_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965227_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965228_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965230_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965231_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965232_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965233_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965234_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965235_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965237_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965238_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965239_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965240_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965241_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965242_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965243_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965244_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965245_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965246_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965247_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965248_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965250_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965251_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965252_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965253_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965254_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965257_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965259_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965260_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965262_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965264_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965266_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965273_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965274_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965275_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965276_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965277_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965279_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965280_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965281_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965282_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965283_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965284_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965285_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965286_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965287_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965288_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965289_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965291_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965292_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965293_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965295_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965296_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965299_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965301_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965302_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965303_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965307_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965308_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965309_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965310_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965311_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965312_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965313_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965317_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965188_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965198_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965200_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965205_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965214_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965223_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965225_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965229_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965265_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965278_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965294_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965300_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965304_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965305_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965306_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965315_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965316_0.png treat image : temp/1746558628_2032542_1356381220_7af21484536fa7b9f80ffa6ad620aeda_rle_crop_3786965183_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965204_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965215_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965219_0.png treat image : temp/1746558628_2032542_1356380842_ae3f58117b5d2aba26df63863810669b_rle_crop_3786965220_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965236_0.png treat image : temp/1746558628_2032542_1356380837_1d45c6a564126afa6fc54ebc090e6836_rle_crop_3786965249_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965255_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965256_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965258_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965261_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965263_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965267_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965268_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965269_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965270_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965271_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965298_0.png treat image : temp/1746558628_2032542_1356380793_5a741196b1c40687e7f0fe9097427a15_rle_crop_3786965314_0.png treat image : temp/1746558628_2032542_1356380834_2d2d2c33f3425d600c7fb276083c97d2_rle_crop_3786965272_0.png treat image : temp/1746558628_2032542_1356380812_34b2c88e9c834e0e45a27b6c83fdccf7_rle_crop_3786965290_0.png treat image : temp/1746558628_2032542_1356380804_2ea8e2de8a388f8563bec286492b4cf0_rle_crop_3786965297_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965199_0.png treat image : temp/1746558628_2032542_1356380845_e099449434dc187801f872096de56bd2_rle_crop_3786965208_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 149 time used for this insertion : 0.020035982131958008 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 149 time used for this insertion : 0.029300928115844727 save missing photos in datou_result : time spend for datou_step_exec : 7.55041241645813 time spend to save output : 0.05397391319274902 total time spend for step 7 : 7.604386329650879 step8:velours_tree Tue May 6 21:14:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13530945777893066 time spend to save output : 4.9114227294921875e-05 total time spend for step 8 : 0.13535857200622559 step9:send_mail_cod Tue May 6 21:14:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22729131_06-05-2025_21_14_49.pdf 22729943 imagette227299431746558889 22729944 imagette227299441746558889 22729945 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227299451746558889 22729946 imagette227299461746558890 22729947 imagette227299471746558890 22729948 imagette227299481746558890 22729949 change filename to text .change filename to text .imagette227299491746558890 22729950 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227299501746558891 22729951 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227299511746558892 22729952 change filename to text .change filename to text .change filename to text .imagette227299521746558893 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22729131 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22729942,22729943,22729944,22729945,22729946,22729947,22729948,22729949,22729950,22729951,22729952?tags=environnement,pet_fonce,flou,papier,mal_croppe,metal,background,pehd,carton,pet_clair,autre args[1356381220] : ((1356381220, -1.5305888343455205, 492688767), (1356381220, 0.25303824693572485, 2107752395), '0.08847427534381808') We are sending mail with results at report@fotonower.com args[1356380845] : ((1356380845, -1.9145305392698397, 492688767), (1356380845, 0.4708562327055808, 2107752395), '0.08847427534381808') We are sending mail with results at report@fotonower.com args[1356380842] : ((1356380842, -2.316296282970996, 492609224), (1356380842, 0.12469535057288256, 2107752395), '0.08847427534381808') We are sending mail with results at report@fotonower.com args[1356380837] : ((1356380837, -2.2752193315222056, 492609224), (1356380837, 0.03997607637884532, 2107752395), '0.08847427534381808') We are sending mail with results at report@fotonower.com args[1356380834] : ((1356380834, 1.6607775844471988, 492688767), (1356380834, 0.3133597757199458, 2107752395), '0.08847427534381808') We are sending mail with results at report@fotonower.com args[1356380812] : ((1356380812, -2.084591590101297, 492609224), (1356380812, 0.23467236407521366, 2107752395), '0.08847427534381808') We are sending mail with results at report@fotonower.com args[1356380804] : ((1356380804, -2.0469770966473204, 492609224), (1356380804, 0.223993541259368, 2107752395), '0.08847427534381808') We are sending mail with results at report@fotonower.com args[1356380793] : ((1356380793, -0.6787152431983611, 492688767), (1356380793, 0.3036422836329221, 2107752395), '0.08847427534381808') We are sending mail with results at report@fotonower.com refus_total : 0.08847427534381808 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22729131 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22729131_06-05-2025_21_14_49.pdf results_Auto_P22729131_06-05-2025_21_14_49.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22729131_06-05-2025_21_14_49.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22729131','results_Auto_P22729131_06-05-2025_21_14_49.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22729131_06-05-2025_21_14_49.pdf','pdf','','0.55','0.08847427534381808') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22729131

https://www.fotonower.com/image?json=false&list_photos_id=1356381220
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356380845
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356380842
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356380837
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356380834
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.6607775844471988)
https://www.fotonower.com/image?json=false&list_photos_id=1356380812
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356380804
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356380793
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.85%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/22729945?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22729949?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22729950?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22729951?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22729952?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22729131_06-05-2025_21_14_49.pdf.

Lien vers velours :https://www.fotonower.com/velours/22729942,22729943,22729944,22729945,22729946,22729947,22729948,22729949,22729950,22729951,22729952?tags=environnement,pet_fonce,flou,papier,mal_croppe,metal,background,pehd,carton,pet_clair,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 06 May 2025 19:14:56 GMT Content-Length: 0 Connection: close X-Message-Id: FGoWVRTRRd6Uy7PXBmEneQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356381220, 1356380845, 1356380842, 1356380837, 1356380834, 1356380812, 1356380804, 1356380793] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356381220', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380845', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380842', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380837', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380834', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380812', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380804', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380793', None, None, None, None, None, '2799045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01338648796081543 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.421112298965454 time spend to save output : 0.013612508773803711 total time spend for step 9 : 6.434724807739258 step10:split_time_score Tue May 6 21:14:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06052025 22729131 Nombre de photos uploadées : 8 / 23040 (0%) 06052025 22729131 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 06052025 22729131 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004405975341796875 elapsed_time : insert_dashboard_record_day_entry 0.0223996639251709 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08132092255607105 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713814_06-05-2025_12_51_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713814 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713814 AND mptpi.`type`=3726 To do Qualite : 0.10237958578664899 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22709064_06-05-2025_08_12_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22709064 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22709064 AND mptpi.`type`=3726 To do Qualite : 0.14297663980233294 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22712580_06-05-2025_10_30_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22712580 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22712580 AND mptpi.`type`=3594 To do Qualite : 0.1363949844260621 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22712582_06-05-2025_10_25_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22712582 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22712582 AND mptpi.`type`=3594 To do Qualite : 0.021461336783706136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22711961_06-05-2025_09_43_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22711961 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22711961 AND mptpi.`type`=3726 To do Qualite : 0.11979912957176281 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713823_06-05-2025_12_42_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713823 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713823 AND mptpi.`type`=3726 To do Qualite : 0.06530374155331652 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713826_06-05-2025_12_32_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713826 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713826 AND mptpi.`type`=3726 To do Qualite : 0.09741873107122248 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713827_06-05-2025_12_22_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713827 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713827 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22729055 order by id desc limit 1 Qualite : 0.2222296174965396 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713834_06-05-2025_12_12_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713834 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713834 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22729058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22729117 order by id desc limit 1 Qualite : 0.08847427534381808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22729131_06-05-2025_21_14_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22729131 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22729131 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22729145 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356381220, 1356380845, 1356380842, 1356380837, 1356380834, 1356380812, 1356380804, 1356380793] Looping around the photos to save general results len do output : 1 /22729131Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356381220', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380845', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380842', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380837', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380834', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380812', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380804', None, None, None, None, None, '2799045') ('3318', None, None, None, None, None, None, None, '2799045') ('3318', '22729131', '1356380793', None, None, None, None, None, '2799045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013423681259155273 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.151691913604736 time spend to save output : 0.013689756393432617 total time spend for step 10 : 4.165381669998169 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 106.81user 103.62system 4:35.35elapsed 76%CPU (0avgtext+0avgdata 4825992maxresident)k 99384inputs+59432outputs (7961major+11314855minor)pagefaults 0swaps