python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 115343 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2964617'] with mtr_portfolio_ids : ['23370994'] and first list_photo_ids : [] new path : /proc/115343/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.4897284507751465 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 27 12:00:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6537 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-27 12:00:34.279663: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-27 12:00:34.307301: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-27 12:00:34.308980: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3620000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-27 12:00:34.309007: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-27 12:00:34.312664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-27 12:00:34.445722: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x41565b90 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-27 12:00:34.445795: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-27 12:00:34.446879: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:00:34.447801: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:00:34.451305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:00:34.455756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:00:34.457373: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:00:34.462039: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:00:34.463435: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:00:34.472418: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:00:34.474122: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:00:34.474245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:00:34.475177: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 12:00:34.475207: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 12:00:34.475222: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 12:00:34.477321: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5165 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-27 12:00:34.836385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:00:34.836547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:00:34.836576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:00:34.836599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:00:34.836622: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:00:34.836644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:00:34.836665: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:00:34.836687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:00:34.838679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:00:34.840388: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:00:34.840487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:00:34.840513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:00:34.840532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:00:34.840553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:00:34.840572: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:00:34.840591: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:00:34.840611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:00:34.842019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:00:34.842117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 12:00:34.842133: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 12:00:34.842146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 12:00:34.843781: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5165 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.p2025-05-27 12:00:47.362970: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:00:47.551673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:00:49.147288: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.148303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.148926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.149512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.150109: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.894119: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-05-27 12:00:49.954177: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.954283: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:49.955770: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.955807: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:49.963630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.963671: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:49.964439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.964461: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:49.970968: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.971026: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:49.971669: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:49.971686: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:50.016122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.016250: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:50.016271: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-27 12:00:50.017403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.017436: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:50.018526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.018564: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:50.025977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.026054: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:00:50.026702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.027392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.028042: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.036379: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.037065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.058994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.059727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.060439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.061106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.065377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.066056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.066702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.067354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.068973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.078597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.079234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.088240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.088829: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.089417: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.089994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.090585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:00:50.091224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 48 Detection mask done ! Trying to reset tf kernel 116288 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 313 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1506 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002897977828979492 nb_pixel_total : 68114 time to create 1 rle with old method : 0.08294177055358887 length of segment : 315 time for calcul the mask position with numpy : 0.004011392593383789 nb_pixel_total : 120459 time to create 1 rle with old method : 0.1436750888824463 length of segment : 590 time for calcul the mask position with numpy : 0.0029196739196777344 nb_pixel_total : 89903 time to create 1 rle with old method : 0.10564208030700684 length of segment : 503 time for calcul the mask position with numpy : 0.0003223419189453125 nb_pixel_total : 13768 time to create 1 rle with old method : 0.016794919967651367 length of segment : 192 time for calcul the mask position with numpy : 0.0006155967712402344 nb_pixel_total : 31230 time to create 1 rle with old method : 0.037883758544921875 length of segment : 234 time for calcul the mask position with numpy : 0.0008819103240966797 nb_pixel_total : 29654 time to create 1 rle with old method : 0.03551650047302246 length of segment : 247 time for calcul the mask position with numpy : 0.0015544891357421875 nb_pixel_total : 87955 time to create 1 rle with old method : 0.10937237739562988 length of segment : 627 time for calcul the mask position with numpy : 0.0007047653198242188 nb_pixel_total : 21901 time to create 1 rle with old method : 0.02565145492553711 length of segment : 219 time for calcul the mask position with numpy : 0.0017337799072265625 nb_pixel_total : 78968 time to create 1 rle with old method : 0.10890460014343262 length of segment : 233 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 13038 time to create 1 rle with old method : 0.015759944915771484 length of segment : 230 time for calcul the mask position with numpy : 0.0029823780059814453 nb_pixel_total : 141608 time to create 1 rle with old method : 0.17217397689819336 length of segment : 463 time for calcul the mask position with numpy : 0.0004382133483886719 nb_pixel_total : 14137 time to create 1 rle with old method : 0.018759965896606445 length of segment : 203 time for calcul the mask position with numpy : 0.0002505779266357422 nb_pixel_total : 9894 time to create 1 rle with old method : 0.011982440948486328 length of segment : 119 time for calcul the mask position with numpy : 0.0007770061492919922 nb_pixel_total : 18922 time to create 1 rle with old method : 0.022961139678955078 length of segment : 213 time for calcul the mask position with numpy : 0.0012950897216796875 nb_pixel_total : 55553 time to create 1 rle with old method : 0.06978678703308105 length of segment : 391 time for calcul the mask position with numpy : 0.0006704330444335938 nb_pixel_total : 22770 time to create 1 rle with old method : 0.02712249755859375 length of segment : 211 time for calcul the mask position with numpy : 0.0008745193481445312 nb_pixel_total : 43874 time to create 1 rle with old method : 0.05268979072570801 length of segment : 344 time for calcul the mask position with numpy : 0.004060268402099609 nb_pixel_total : 109657 time to create 1 rle with old method : 0.13278746604919434 length of segment : 819 time for calcul the mask position with numpy : 0.002675294876098633 nb_pixel_total : 77683 time to create 1 rle with old method : 0.0912160873413086 length of segment : 608 time for calcul the mask position with numpy : 0.00042247772216796875 nb_pixel_total : 19293 time to create 1 rle with old method : 0.02323603630065918 length of segment : 186 time for calcul the mask position with numpy : 0.0004818439483642578 nb_pixel_total : 25333 time to create 1 rle with old method : 0.030614852905273438 length of segment : 213 time for calcul the mask position with numpy : 0.0003514289855957031 nb_pixel_total : 19077 time to create 1 rle with old method : 0.0229036808013916 length of segment : 127 time for calcul the mask position with numpy : 0.0013675689697265625 nb_pixel_total : 73107 time to create 1 rle with old method : 0.09085607528686523 length of segment : 390 time for calcul the mask position with numpy : 0.0002448558807373047 nb_pixel_total : 10451 time to create 1 rle with old method : 0.01293635368347168 length of segment : 101 time for calcul the mask position with numpy : 0.001495361328125 nb_pixel_total : 61964 time to create 1 rle with old method : 0.07535243034362793 length of segment : 404 time for calcul the mask position with numpy : 0.0030074119567871094 nb_pixel_total : 138928 time to create 1 rle with old method : 0.1629469394683838 length of segment : 563 time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 20758 time to create 1 rle with old method : 0.024854660034179688 length of segment : 206 time for calcul the mask position with numpy : 0.001104593276977539 nb_pixel_total : 39178 time to create 1 rle with old method : 0.046430110931396484 length of segment : 398 time for calcul the mask position with numpy : 0.004058837890625 nb_pixel_total : 113827 time to create 1 rle with old method : 0.13364148139953613 length of segment : 243 time for calcul the mask position with numpy : 0.004315853118896484 nb_pixel_total : 109493 time to create 1 rle with old method : 0.13045287132263184 length of segment : 350 time for calcul the mask position with numpy : 0.001234292984008789 nb_pixel_total : 21690 time to create 1 rle with old method : 0.026187419891357422 length of segment : 194 time for calcul the mask position with numpy : 0.005742073059082031 nb_pixel_total : 143782 time to create 1 rle with old method : 0.16692781448364258 length of segment : 628 time for calcul the mask position with numpy : 0.0006382465362548828 nb_pixel_total : 11818 time to create 1 rle with old method : 0.014110565185546875 length of segment : 144 time for calcul the mask position with numpy : 0.0005943775177001953 nb_pixel_total : 23080 time to create 1 rle with old method : 0.02774214744567871 length of segment : 263 time for calcul the mask position with numpy : 0.0015611648559570312 nb_pixel_total : 39754 time to create 1 rle with old method : 0.04648137092590332 length of segment : 227 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 6433 time to create 1 rle with old method : 0.007636070251464844 length of segment : 100 time for calcul the mask position with numpy : 0.0005719661712646484 nb_pixel_total : 13272 time to create 1 rle with old method : 0.015470266342163086 length of segment : 137 time for calcul the mask position with numpy : 0.0014560222625732422 nb_pixel_total : 23462 time to create 1 rle with old method : 0.02771759033203125 length of segment : 242 time for calcul the mask position with numpy : 0.00038361549377441406 nb_pixel_total : 8953 time to create 1 rle with old method : 0.010843276977539062 length of segment : 93 time for calcul the mask position with numpy : 0.0007352828979492188 nb_pixel_total : 28142 time to create 1 rle with old method : 0.03396773338317871 length of segment : 233 time for calcul the mask position with numpy : 0.0017673969268798828 nb_pixel_total : 46855 time to create 1 rle with old method : 0.054174184799194336 length of segment : 200 time for calcul the mask position with numpy : 0.000980377197265625 nb_pixel_total : 26395 time to create 1 rle with old method : 0.03250312805175781 length of segment : 243 time for calcul the mask position with numpy : 0.0016865730285644531 nb_pixel_total : 28818 time to create 1 rle with old method : 0.046723365783691406 length of segment : 227 time for calcul the mask position with numpy : 0.0019598007202148438 nb_pixel_total : 68429 time to create 1 rle with old method : 0.08060097694396973 length of segment : 338 time for calcul the mask position with numpy : 0.0058231353759765625 nb_pixel_total : 156341 time to create 1 rle with new method : 0.012335062026977539 length of segment : 599 time for calcul the mask position with numpy : 0.005580425262451172 nb_pixel_total : 176833 time to create 1 rle with new method : 0.012142658233642578 length of segment : 438 time for calcul the mask position with numpy : 0.004311323165893555 nb_pixel_total : 81622 time to create 1 rle with old method : 0.09638023376464844 length of segment : 399 time for calcul the mask position with numpy : 0.001619577407836914 nb_pixel_total : 40714 time to create 1 rle with old method : 0.04754137992858887 length of segment : 325 time for calcul the mask position with numpy : 0.0004181861877441406 nb_pixel_total : 9033 time to create 1 rle with old method : 0.011075735092163086 length of segment : 127 time for calcul the mask position with numpy : 0.0008146762847900391 nb_pixel_total : 33437 time to create 1 rle with old method : 0.03947925567626953 length of segment : 124 time for calcul the mask position with numpy : 0.000850677490234375 nb_pixel_total : 30822 time to create 1 rle with old method : 0.036492347717285156 length of segment : 234 time for calcul the mask position with numpy : 0.0013713836669921875 nb_pixel_total : 44105 time to create 1 rle with old method : 0.05304265022277832 length of segment : 264 time for calcul the mask position with numpy : 0.00039696693420410156 nb_pixel_total : 26417 time to create 1 rle with old method : 0.03162741661071777 length of segment : 185 time for calcul the mask position with numpy : 0.005836963653564453 nb_pixel_total : 192990 time to create 1 rle with new method : 0.012226104736328125 length of segment : 710 time for calcul the mask position with numpy : 0.002340078353881836 nb_pixel_total : 125466 time to create 1 rle with old method : 0.14694833755493164 length of segment : 446 time for calcul the mask position with numpy : 0.001993417739868164 nb_pixel_total : 145979 time to create 1 rle with old method : 0.17139124870300293 length of segment : 501 time for calcul the mask position with numpy : 0.00033736228942871094 nb_pixel_total : 6774 time to create 1 rle with old method : 0.008000612258911133 length of segment : 138 time for calcul the mask position with numpy : 0.0009272098541259766 nb_pixel_total : 31447 time to create 1 rle with old method : 0.03718876838684082 length of segment : 204 time for calcul the mask position with numpy : 0.0045659542083740234 nb_pixel_total : 82385 time to create 1 rle with old method : 0.09691619873046875 length of segment : 472 time for calcul the mask position with numpy : 0.002552032470703125 nb_pixel_total : 73151 time to create 1 rle with old method : 0.08541703224182129 length of segment : 485 time for calcul the mask position with numpy : 0.0019354820251464844 nb_pixel_total : 56402 time to create 1 rle with old method : 0.06587457656860352 length of segment : 293 time for calcul the mask position with numpy : 0.001247406005859375 nb_pixel_total : 33963 time to create 1 rle with old method : 0.03898358345031738 length of segment : 312 time for calcul the mask position with numpy : 0.00079345703125 nb_pixel_total : 19031 time to create 1 rle with old method : 0.022669553756713867 length of segment : 184 time for calcul the mask position with numpy : 0.00322723388671875 nb_pixel_total : 79566 time to create 1 rle with old method : 0.09152698516845703 length of segment : 679 time for calcul the mask position with numpy : 0.0005519390106201172 nb_pixel_total : 12240 time to create 1 rle with old method : 0.014531373977661133 length of segment : 143 time for calcul the mask position with numpy : 0.0011353492736816406 nb_pixel_total : 32027 time to create 1 rle with old method : 0.03796577453613281 length of segment : 222 time for calcul the mask position with numpy : 0.0004706382751464844 nb_pixel_total : 8131 time to create 1 rle with old method : 0.009934186935424805 length of segment : 110 time for calcul the mask position with numpy : 0.0008282661437988281 nb_pixel_total : 29701 time to create 1 rle with old method : 0.03541088104248047 length of segment : 168 time for calcul the mask position with numpy : 0.0002033710479736328 nb_pixel_total : 4069 time to create 1 rle with old method : 0.004900932312011719 length of segment : 80 time for calcul the mask position with numpy : 0.0017123222351074219 nb_pixel_total : 53210 time to create 1 rle with old method : 0.0624232292175293 length of segment : 319 time for calcul the mask position with numpy : 0.0004432201385498047 nb_pixel_total : 15640 time to create 1 rle with old method : 0.01867389678955078 length of segment : 173 time for calcul the mask position with numpy : 0.002048492431640625 nb_pixel_total : 50878 time to create 1 rle with old method : 0.05943942070007324 length of segment : 335 time for calcul the mask position with numpy : 0.0009748935699462891 nb_pixel_total : 24861 time to create 1 rle with old method : 0.030068159103393555 length of segment : 231 time for calcul the mask position with numpy : 0.0005960464477539062 nb_pixel_total : 13400 time to create 1 rle with old method : 0.016560792922973633 length of segment : 145 time for calcul the mask position with numpy : 0.0018451213836669922 nb_pixel_total : 59082 time to create 1 rle with old method : 0.07026410102844238 length of segment : 263 time for calcul the mask position with numpy : 0.0007593631744384766 nb_pixel_total : 23313 time to create 1 rle with old method : 0.028505563735961914 length of segment : 109 time for calcul the mask position with numpy : 0.0019898414611816406 nb_pixel_total : 57023 time to create 1 rle with old method : 0.0688331127166748 length of segment : 275 time for calcul the mask position with numpy : 0.0011284351348876953 nb_pixel_total : 21116 time to create 1 rle with old method : 0.025601863861083984 length of segment : 265 time for calcul the mask position with numpy : 0.0016443729400634766 nb_pixel_total : 49632 time to create 1 rle with old method : 0.05884838104248047 length of segment : 247 time for calcul the mask position with numpy : 0.003001689910888672 nb_pixel_total : 67251 time to create 1 rle with old method : 0.07895612716674805 length of segment : 441 time for calcul the mask position with numpy : 0.0003478527069091797 nb_pixel_total : 5579 time to create 1 rle with old method : 0.006931304931640625 length of segment : 79 time for calcul the mask position with numpy : 0.0011327266693115234 nb_pixel_total : 28807 time to create 1 rle with old method : 0.03475213050842285 length of segment : 214 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 7076 time to create 1 rle with old method : 0.008667707443237305 length of segment : 116 time for calcul the mask position with numpy : 0.00658416748046875 nb_pixel_total : 129583 time to create 1 rle with old method : 0.15366125106811523 length of segment : 527 time for calcul the mask position with numpy : 0.0009832382202148438 nb_pixel_total : 18643 time to create 1 rle with old method : 0.026352643966674805 length of segment : 188 time for calcul the mask position with numpy : 0.003131866455078125 nb_pixel_total : 60527 time to create 1 rle with old method : 0.09564018249511719 length of segment : 351 time for calcul the mask position with numpy : 0.0006234645843505859 nb_pixel_total : 12343 time to create 1 rle with old method : 0.014815807342529297 length of segment : 133 time for calcul the mask position with numpy : 0.002348661422729492 nb_pixel_total : 44289 time to create 1 rle with old method : 0.056801795959472656 length of segment : 298 time for calcul the mask position with numpy : 0.0004818439483642578 nb_pixel_total : 5764 time to create 1 rle with old method : 0.009975671768188477 length of segment : 118 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 8902 time to create 1 rle with old method : 0.011167526245117188 length of segment : 76 time for calcul the mask position with numpy : 0.00038504600524902344 nb_pixel_total : 13415 time to create 1 rle with old method : 0.01614665985107422 length of segment : 168 time for calcul the mask position with numpy : 0.0005366802215576172 nb_pixel_total : 12541 time to create 1 rle with old method : 0.015045166015625 length of segment : 212 time for calcul the mask position with numpy : 0.002796649932861328 nb_pixel_total : 68817 time to create 1 rle with old method : 0.08019495010375977 length of segment : 627 time for calcul the mask position with numpy : 0.0017347335815429688 nb_pixel_total : 43833 time to create 1 rle with old method : 0.05104231834411621 length of segment : 228 time for calcul the mask position with numpy : 0.0018949508666992188 nb_pixel_total : 42424 time to create 1 rle with old method : 0.05033588409423828 length of segment : 185 time for calcul the mask position with numpy : 0.0009179115295410156 nb_pixel_total : 33467 time to create 1 rle with old method : 0.03900909423828125 length of segment : 262 time for calcul the mask position with numpy : 0.0023872852325439453 nb_pixel_total : 59682 time to create 1 rle with old method : 0.07017850875854492 length of segment : 342 time for calcul the mask position with numpy : 0.0028371810913085938 nb_pixel_total : 58663 time to create 1 rle with old method : 0.0681002140045166 length of segment : 277 time for calcul the mask position with numpy : 0.0016961097717285156 nb_pixel_total : 28036 time to create 1 rle with old method : 0.03368353843688965 length of segment : 161 time for calcul the mask position with numpy : 0.0027494430541992188 nb_pixel_total : 62729 time to create 1 rle with old method : 0.07246661186218262 length of segment : 434 time for calcul the mask position with numpy : 0.001299142837524414 nb_pixel_total : 28008 time to create 1 rle with old method : 0.033049583435058594 length of segment : 224 time for calcul the mask position with numpy : 0.0006961822509765625 nb_pixel_total : 21437 time to create 1 rle with old method : 0.025710344314575195 length of segment : 166 time for calcul the mask position with numpy : 0.0009024143218994141 nb_pixel_total : 9685 time to create 1 rle with old method : 0.011531591415405273 length of segment : 133 time for calcul the mask position with numpy : 0.003687620162963867 nb_pixel_total : 62949 time to create 1 rle with old method : 0.07399606704711914 length of segment : 332 time for calcul the mask position with numpy : 0.0037839412689208984 nb_pixel_total : 95945 time to create 1 rle with old method : 0.11231827735900879 length of segment : 483 time for calcul the mask position with numpy : 0.001550912857055664 nb_pixel_total : 24297 time to create 1 rle with old method : 0.02872633934020996 length of segment : 193 time for calcul the mask position with numpy : 0.0009050369262695312 nb_pixel_total : 23786 time to create 1 rle with old method : 0.03018951416015625 length of segment : 106 time for calcul the mask position with numpy : 0.001004934310913086 nb_pixel_total : 30209 time to create 1 rle with old method : 0.03544330596923828 length of segment : 255 time for calcul the mask position with numpy : 0.0011262893676757812 nb_pixel_total : 32598 time to create 1 rle with old method : 0.03862333297729492 length of segment : 272 time for calcul the mask position with numpy : 0.0034291744232177734 nb_pixel_total : 67890 time to create 1 rle with old method : 0.08307409286499023 length of segment : 235 time for calcul the mask position with numpy : 0.0013632774353027344 nb_pixel_total : 20316 time to create 1 rle with old method : 0.024326801300048828 length of segment : 202 time for calcul the mask position with numpy : 0.0023927688598632812 nb_pixel_total : 60251 time to create 1 rle with old method : 0.07138848304748535 length of segment : 302 time for calcul the mask position with numpy : 0.0012657642364501953 nb_pixel_total : 27165 time to create 1 rle with old method : 0.03248882293701172 length of segment : 209 time for calcul the mask position with numpy : 0.004241943359375 nb_pixel_total : 69080 time to create 1 rle with old method : 0.07917046546936035 length of segment : 380 time for calcul the mask position with numpy : 0.0020580291748046875 nb_pixel_total : 61970 time to create 1 rle with old method : 0.07226324081420898 length of segment : 297 time for calcul the mask position with numpy : 0.0007779598236083984 nb_pixel_total : 18880 time to create 1 rle with old method : 0.02256488800048828 length of segment : 149 time for calcul the mask position with numpy : 0.003943681716918945 nb_pixel_total : 108575 time to create 1 rle with old method : 0.12938833236694336 length of segment : 356 time for calcul the mask position with numpy : 0.0008332729339599609 nb_pixel_total : 21695 time to create 1 rle with old method : 0.02571558952331543 length of segment : 188 time for calcul the mask position with numpy : 0.0025942325592041016 nb_pixel_total : 48846 time to create 1 rle with old method : 0.05765581130981445 length of segment : 378 time for calcul the mask position with numpy : 0.0006916522979736328 nb_pixel_total : 22101 time to create 1 rle with old method : 0.026217937469482422 length of segment : 178 time for calcul the mask position with numpy : 0.0005624294281005859 nb_pixel_total : 10262 time to create 1 rle with old method : 0.012755393981933594 length of segment : 116 time for calcul the mask position with numpy : 0.000904083251953125 nb_pixel_total : 16012 time to create 1 rle with old method : 0.019383668899536133 length of segment : 151 time for calcul the mask position with numpy : 0.0033380985260009766 nb_pixel_total : 62721 time to create 1 rle with old method : 0.07454657554626465 length of segment : 325 time for calcul the mask position with numpy : 0.001245260238647461 nb_pixel_total : 21086 time to create 1 rle with old method : 0.025626420974731445 length of segment : 201 time for calcul the mask position with numpy : 0.0004589557647705078 nb_pixel_total : 11743 time to create 1 rle with old method : 0.014543771743774414 length of segment : 104 time for calcul the mask position with numpy : 0.00305938720703125 nb_pixel_total : 57429 time to create 1 rle with old method : 0.0675663948059082 length of segment : 324 time for calcul the mask position with numpy : 0.002640962600708008 nb_pixel_total : 58386 time to create 1 rle with old method : 0.0676114559173584 length of segment : 331 time for calcul the mask position with numpy : 0.0032770633697509766 nb_pixel_total : 79821 time to create 1 rle with old method : 0.09287166595458984 length of segment : 311 time for calcul the mask position with numpy : 0.0021686553955078125 nb_pixel_total : 45038 time to create 1 rle with old method : 0.05254936218261719 length of segment : 362 time for calcul the mask position with numpy : 0.0007982254028320312 nb_pixel_total : 11584 time to create 1 rle with old method : 0.014051198959350586 length of segment : 208 time for calcul the mask position with numpy : 0.003643035888671875 nb_pixel_total : 47706 time to create 1 rle with old method : 0.05726146697998047 length of segment : 592 time for calcul the mask position with numpy : 0.004055023193359375 nb_pixel_total : 64627 time to create 1 rle with old method : 0.07660198211669922 length of segment : 306 time for calcul the mask position with numpy : 0.0015761852264404297 nb_pixel_total : 28095 time to create 1 rle with old method : 0.03874349594116211 length of segment : 231 time for calcul the mask position with numpy : 0.0014047622680664062 nb_pixel_total : 24237 time to create 1 rle with old method : 0.036646366119384766 length of segment : 225 time for calcul the mask position with numpy : 0.001020669937133789 nb_pixel_total : 15665 time to create 1 rle with old method : 0.01921868324279785 length of segment : 190 time for calcul the mask position with numpy : 0.0009319782257080078 nb_pixel_total : 14308 time to create 1 rle with old method : 0.01777791976928711 length of segment : 159 time for calcul the mask position with numpy : 0.0023453235626220703 nb_pixel_total : 51219 time to create 1 rle with old method : 0.06134533882141113 length of segment : 359 time for calcul the mask position with numpy : 0.0010673999786376953 nb_pixel_total : 22265 time to create 1 rle with old method : 0.02682971954345703 length of segment : 471 time for calcul the mask position with numpy : 0.0013799667358398438 nb_pixel_total : 22121 time to create 1 rle with old method : 0.026425600051879883 length of segment : 232 time for calcul the mask position with numpy : 0.008622884750366211 nb_pixel_total : 134642 time to create 1 rle with old method : 0.1850435733795166 length of segment : 691 time for calcul the mask position with numpy : 0.0008976459503173828 nb_pixel_total : 15941 time to create 1 rle with old method : 0.019034624099731445 length of segment : 179 time for calcul the mask position with numpy : 0.0024318695068359375 nb_pixel_total : 76217 time to create 1 rle with old method : 0.08981013298034668 length of segment : 319 time for calcul the mask position with numpy : 0.0014183521270751953 nb_pixel_total : 22806 time to create 1 rle with old method : 0.027025938034057617 length of segment : 390 time for calcul the mask position with numpy : 0.0009560585021972656 nb_pixel_total : 7015 time to create 1 rle with old method : 0.008690118789672852 length of segment : 284 time for calcul the mask position with numpy : 0.00481414794921875 nb_pixel_total : 167186 time to create 1 rle with new method : 0.011533737182617188 length of segment : 494 time spent for convertir_results : 14.589305400848389 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 145 chid ids of type : 3594 Number RLEs to save : 41445 save missing photos in datou_result : time spend for datou_step_exec : 95.89536356925964 time spend to save output : 170.31775164604187 total time spend for step 1 : 266.2131152153015 step2:crop_condition Tue May 27 12:04:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 145 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 123 About to insert : list_path_to_insert length 123 new photo from crops ! About to upload 123 photos upload in portfolio : 3736932 init cache_photo without model_param we have 123 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748340330_115343 we have uploaded 123 photos in the portfolio 3736932 time of upload the photos Elapsed time : 52.60198497772217 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748340386_115343 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.676226854324341 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748340393_115343 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6872885227203369 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748340397_115343 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.39691162109375 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748340405_115343 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.593360185623169 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360738216, 1360738184, 1360737892, 1360737859, 1360737827, 1360737797, 1360737518] Looping around the photos to save general results len do output : 145 /1361272100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361272268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738216', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738184', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737892', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737859', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737827', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737797', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737518', None, None, None, None, None, '2964617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 442 time used for this insertion : 0.3573307991027832 save_final save missing photos in datou_result : time spend for datou_step_exec : 108.50173473358154 time spend to save output : 0.361713171005249 total time spend for step 2 : 108.86344790458679 step3:rle_unique_nms_with_priority Tue May 27 12:06:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 145 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 12.321701526641846 time for calcul the mask position with numpy : 0.8690054416656494 nb_pixel_total : 7232093 time to create 1 rle with new method : 0.5475530624389648 time for calcul the mask position with numpy : 0.039673805236816406 nb_pixel_total : 19293 time to create 1 rle with old method : 0.02212238311767578 time for calcul the mask position with numpy : 0.025391340255737305 nb_pixel_total : 72136 time to create 1 rle with old method : 0.08355522155761719 time for calcul the mask position with numpy : 0.024918794631958008 nb_pixel_total : 109494 time to create 1 rle with old method : 0.12278246879577637 time for calcul the mask position with numpy : 0.023999452590942383 nb_pixel_total : 43874 time to create 1 rle with old method : 0.05024242401123047 time for calcul the mask position with numpy : 0.023502111434936523 nb_pixel_total : 22770 time to create 1 rle with old method : 0.025233983993530273 time for calcul the mask position with numpy : 0.02746295928955078 nb_pixel_total : 55553 time to create 1 rle with old method : 0.07324934005737305 time for calcul the mask position with numpy : 0.030269384384155273 nb_pixel_total : 18558 time to create 1 rle with old method : 0.024903059005737305 time for calcul the mask position with numpy : 0.024590730667114258 nb_pixel_total : 9894 time to create 1 rle with old method : 0.011113882064819336 time for calcul the mask position with numpy : 0.02437305450439453 nb_pixel_total : 14137 time to create 1 rle with old method : 0.016397953033447266 time for calcul the mask position with numpy : 0.025457143783569336 nb_pixel_total : 141608 time to create 1 rle with old method : 0.15989899635314941 time for calcul the mask position with numpy : 0.024024009704589844 nb_pixel_total : 13038 time to create 1 rle with old method : 0.014977455139160156 time for calcul the mask position with numpy : 0.024062156677246094 nb_pixel_total : 78968 time to create 1 rle with old method : 0.08883285522460938 time for calcul the mask position with numpy : 0.024731874465942383 nb_pixel_total : 21901 time to create 1 rle with old method : 0.025611162185668945 time for calcul the mask position with numpy : 0.026064157485961914 nb_pixel_total : 87955 time to create 1 rle with old method : 0.09810280799865723 time for calcul the mask position with numpy : 0.023888587951660156 nb_pixel_total : 29654 time to create 1 rle with old method : 0.03389620780944824 time for calcul the mask position with numpy : 0.025562763214111328 nb_pixel_total : 31230 time to create 1 rle with old method : 0.03499794006347656 time for calcul the mask position with numpy : 0.02379465103149414 nb_pixel_total : 13768 time to create 1 rle with old method : 0.01566481590270996 time for calcul the mask position with numpy : 0.02451801300048828 nb_pixel_total : 89903 time to create 1 rle with old method : 0.09931731224060059 time for calcul the mask position with numpy : 0.024988412857055664 nb_pixel_total : 120459 time to create 1 rle with old method : 0.1325669288635254 time for calcul the mask position with numpy : 0.023949146270751953 nb_pixel_total : 68114 time to create 1 rle with old method : 0.07532000541687012 create new chi : 3.1777448654174805 time to delete rle : 0.022167682647705078 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15766 TO DO : save crop sub photo not yet done ! save time : 64.92537355422974 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 10.494905948638916 time for calcul the mask position with numpy : 0.9558286666870117 nb_pixel_total : 7345741 time to create 1 rle with new method : 0.8596022129058838 time for calcul the mask position with numpy : 0.04110217094421387 nb_pixel_total : 46855 time to create 1 rle with old method : 0.05475044250488281 time for calcul the mask position with numpy : 0.0463109016418457 nb_pixel_total : 7890 time to create 1 rle with old method : 0.010922431945800781 time for calcul the mask position with numpy : 0.050095558166503906 nb_pixel_total : 8953 time to create 1 rle with old method : 0.01063084602355957 time for calcul the mask position with numpy : 0.04801821708679199 nb_pixel_total : 23462 time to create 1 rle with old method : 0.0278933048248291 time for calcul the mask position with numpy : 0.04087519645690918 nb_pixel_total : 8160 time to create 1 rle with old method : 0.00922393798828125 time for calcul the mask position with numpy : 0.04165768623352051 nb_pixel_total : 6339 time to create 1 rle with old method : 0.007490873336791992 time for calcul the mask position with numpy : 0.040862321853637695 nb_pixel_total : 39754 time to create 1 rle with old method : 0.04736471176147461 time for calcul the mask position with numpy : 0.043123722076416016 nb_pixel_total : 18792 time to create 1 rle with old method : 0.021946430206298828 time for calcul the mask position with numpy : 0.040058135986328125 nb_pixel_total : 11818 time to create 1 rle with old method : 0.013487100601196289 time for calcul the mask position with numpy : 0.03980588912963867 nb_pixel_total : 143782 time to create 1 rle with old method : 0.18651413917541504 time for calcul the mask position with numpy : 0.03876948356628418 nb_pixel_total : 21690 time to create 1 rle with old method : 0.024770259857177734 time for calcul the mask position with numpy : 0.03905153274536133 nb_pixel_total : 109493 time to create 1 rle with old method : 0.12262439727783203 time for calcul the mask position with numpy : 0.039160728454589844 nb_pixel_total : 112875 time to create 1 rle with old method : 0.12735581398010254 time for calcul the mask position with numpy : 0.03747415542602539 nb_pixel_total : 39178 time to create 1 rle with old method : 0.043897390365600586 time for calcul the mask position with numpy : 0.04238748550415039 nb_pixel_total : 20758 time to create 1 rle with old method : 0.03482937812805176 time for calcul the mask position with numpy : 0.025423765182495117 nb_pixel_total : 138928 time to create 1 rle with old method : 0.15435147285461426 time for calcul the mask position with numpy : 0.024225950241088867 nb_pixel_total : 61964 time to create 1 rle with old method : 0.0690155029296875 time for calcul the mask position with numpy : 0.02399301528930664 nb_pixel_total : 10451 time to create 1 rle with old method : 0.011948823928833008 time for calcul the mask position with numpy : 0.02523040771484375 nb_pixel_total : 73107 time to create 1 rle with old method : 0.08730649948120117 time for calcul the mask position with numpy : 0.0249021053314209 nb_pixel_total : 19077 time to create 1 rle with old method : 0.021481037139892578 time for calcul the mask position with numpy : 0.024504899978637695 nb_pixel_total : 25333 time to create 1 rle with old method : 0.029074907302856445 create new chi : 3.7538602352142334 time to delete rle : 0.0016436576843261719 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 12618 TO DO : save crop sub photo not yet done ! save time : 27.02268099784851 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 10.197399139404297 time for calcul the mask position with numpy : 0.5865213871002197 nb_pixel_total : 7205732 time to create 1 rle with new method : 1.171180248260498 time for calcul the mask position with numpy : 0.026605606079101562 nb_pixel_total : 31447 time to create 1 rle with old method : 0.03607010841369629 time for calcul the mask position with numpy : 0.024153947830200195 nb_pixel_total : 6774 time to create 1 rle with old method : 0.0079345703125 time for calcul the mask position with numpy : 0.02460026741027832 nb_pixel_total : 27450 time to create 1 rle with old method : 0.03199267387390137 time for calcul the mask position with numpy : 0.02695775032043457 nb_pixel_total : 125466 time to create 1 rle with old method : 0.15271902084350586 time for calcul the mask position with numpy : 0.030822038650512695 nb_pixel_total : 192990 time to create 1 rle with new method : 1.323112964630127 time for calcul the mask position with numpy : 0.02398395538330078 nb_pixel_total : 7992 time to create 1 rle with old method : 0.008705615997314453 time for calcul the mask position with numpy : 0.02334308624267578 nb_pixel_total : 44105 time to create 1 rle with old method : 0.04786992073059082 time for calcul the mask position with numpy : 0.024866580963134766 nb_pixel_total : 30822 time to create 1 rle with old method : 0.03509521484375 time for calcul the mask position with numpy : 0.024727344512939453 nb_pixel_total : 33437 time to create 1 rle with old method : 0.03784513473510742 time for calcul the mask position with numpy : 0.026140689849853516 nb_pixel_total : 9033 time to create 1 rle with old method : 0.010529756546020508 time for calcul the mask position with numpy : 0.02448582649230957 nb_pixel_total : 40714 time to create 1 rle with old method : 0.046654462814331055 time for calcul the mask position with numpy : 0.025024890899658203 nb_pixel_total : 81622 time to create 1 rle with old method : 0.09290289878845215 time for calcul the mask position with numpy : 0.02543807029724121 nb_pixel_total : 176833 time to create 1 rle with new method : 0.5742535591125488 time for calcul the mask position with numpy : 0.03000187873840332 nb_pixel_total : 156341 time to create 1 rle with new method : 0.874671459197998 time for calcul the mask position with numpy : 0.026154756546020508 nb_pixel_total : 68429 time to create 1 rle with old method : 0.07736635208129883 time for calcul the mask position with numpy : 0.027849197387695312 nb_pixel_total : 28818 time to create 1 rle with old method : 0.03521156311035156 time for calcul the mask position with numpy : 0.030872344970703125 nb_pixel_total : 26395 time to create 1 rle with old method : 0.03648114204406738 create new chi : 5.7597644329071045 time to delete rle : 0.001928567886352539 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12510 TO DO : save crop sub photo not yet done ! save time : 22.84993052482605 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 8.604519128799438 time for calcul the mask position with numpy : 0.8058555126190186 nb_pixel_total : 7730750 time to create 1 rle with new method : 1.6764049530029297 time for calcul the mask position with numpy : 0.025337696075439453 nb_pixel_total : 13400 time to create 1 rle with old method : 0.015877723693847656 time for calcul the mask position with numpy : 0.026558399200439453 nb_pixel_total : 24861 time to create 1 rle with old method : 0.029238462448120117 time for calcul the mask position with numpy : 0.026404619216918945 nb_pixel_total : 50878 time to create 1 rle with old method : 0.05966997146606445 time for calcul the mask position with numpy : 0.02483367919921875 nb_pixel_total : 9215 time to create 1 rle with old method : 0.01073312759399414 time for calcul the mask position with numpy : 0.025281429290771484 nb_pixel_total : 53210 time to create 1 rle with old method : 0.0621030330657959 time for calcul the mask position with numpy : 0.025781631469726562 nb_pixel_total : 4069 time to create 1 rle with old method : 0.00471043586730957 time for calcul the mask position with numpy : 0.025356054306030273 nb_pixel_total : 14902 time to create 1 rle with old method : 0.017374277114868164 time for calcul the mask position with numpy : 0.02533411979675293 nb_pixel_total : 8131 time to create 1 rle with old method : 0.009595632553100586 time for calcul the mask position with numpy : 0.02594614028930664 nb_pixel_total : 32027 time to create 1 rle with old method : 0.03693652153015137 time for calcul the mask position with numpy : 0.026076793670654297 nb_pixel_total : 12240 time to create 1 rle with old method : 0.014240503311157227 time for calcul the mask position with numpy : 0.025657176971435547 nb_pixel_total : 75785 time to create 1 rle with old method : 0.08694076538085938 time for calcul the mask position with numpy : 0.025105714797973633 nb_pixel_total : 19031 time to create 1 rle with old method : 0.021364212036132812 time for calcul the mask position with numpy : 0.02690863609313965 nb_pixel_total : 33963 time to create 1 rle with old method : 0.03843426704406738 time for calcul the mask position with numpy : 0.024442672729492188 nb_pixel_total : 56402 time to create 1 rle with old method : 0.06448173522949219 time for calcul the mask position with numpy : 0.025275707244873047 nb_pixel_total : 73151 time to create 1 rle with old method : 0.08416152000427246 time for calcul the mask position with numpy : 0.02520918846130371 nb_pixel_total : 82385 time to create 1 rle with old method : 0.0949258804321289 create new chi : 3.5895142555236816 time to delete rle : 0.0014083385467529297 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10390 TO DO : save crop sub photo not yet done ! save time : 31.043843269348145 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 12.400911092758179 time for calcul the mask position with numpy : 0.3351283073425293 nb_pixel_total : 7481105 time to create 1 rle with new method : 0.45006608963012695 time for calcul the mask position with numpy : 0.02520442008972168 nb_pixel_total : 33467 time to create 1 rle with old method : 0.03853178024291992 time for calcul the mask position with numpy : 0.024338960647583008 nb_pixel_total : 42424 time to create 1 rle with old method : 0.049945831298828125 time for calcul the mask position with numpy : 0.025072574615478516 nb_pixel_total : 43833 time to create 1 rle with old method : 0.05089116096496582 time for calcul the mask position with numpy : 0.025362014770507812 nb_pixel_total : 68817 time to create 1 rle with old method : 0.08029961585998535 time for calcul the mask position with numpy : 0.02646780014038086 nb_pixel_total : 12541 time to create 1 rle with old method : 0.01497793197631836 time for calcul the mask position with numpy : 0.025495052337646484 nb_pixel_total : 13283 time to create 1 rle with old method : 0.0158843994140625 time for calcul the mask position with numpy : 0.025780200958251953 nb_pixel_total : 8902 time to create 1 rle with old method : 0.01060938835144043 time for calcul the mask position with numpy : 0.02665424346923828 nb_pixel_total : 5764 time to create 1 rle with old method : 0.006955862045288086 time for calcul the mask position with numpy : 0.02633047103881836 nb_pixel_total : 44289 time to create 1 rle with old method : 0.05605936050415039 time for calcul the mask position with numpy : 0.03067755699157715 nb_pixel_total : 12343 time to create 1 rle with old method : 0.015626192092895508 time for calcul the mask position with numpy : 0.028937578201293945 nb_pixel_total : 60527 time to create 1 rle with old method : 0.078765869140625 time for calcul the mask position with numpy : 0.030536890029907227 nb_pixel_total : 18643 time to create 1 rle with old method : 0.024070262908935547 time for calcul the mask position with numpy : 0.027310848236083984 nb_pixel_total : 129583 time to create 1 rle with old method : 0.2683382034301758 time for calcul the mask position with numpy : 0.030643939971923828 nb_pixel_total : 7076 time to create 1 rle with old method : 0.011983633041381836 time for calcul the mask position with numpy : 0.069000244140625 nb_pixel_total : 28807 time to create 1 rle with old method : 0.11713790893554688 time for calcul the mask position with numpy : 0.041486263275146484 nb_pixel_total : 5579 time to create 1 rle with old method : 0.04129791259765625 time for calcul the mask position with numpy : 0.06559634208679199 nb_pixel_total : 67251 time to create 1 rle with old method : 0.09132671356201172 time for calcul the mask position with numpy : 0.04474282264709473 nb_pixel_total : 49632 time to create 1 rle with old method : 0.06885004043579102 time for calcul the mask position with numpy : 0.06037330627441406 nb_pixel_total : 21116 time to create 1 rle with old method : 0.054663658142089844 time for calcul the mask position with numpy : 0.04423213005065918 nb_pixel_total : 57023 time to create 1 rle with old method : 0.1070551872253418 time for calcul the mask position with numpy : 0.04036355018615723 nb_pixel_total : 23313 time to create 1 rle with old method : 0.04474210739135742 time for calcul the mask position with numpy : 0.033490896224975586 nb_pixel_total : 59082 time to create 1 rle with old method : 0.09934401512145996 create new chi : 2.9556496143341064 time to delete rle : 0.002953767776489258 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 12866 TO DO : save crop sub photo not yet done ! save time : 42.13067412376404 nb_obj : 32 nb_hashtags : 2 time to prepare the origin masks : 4.789576530456543 time for calcul the mask position with numpy : 0.7331717014312744 nb_pixel_total : 6912807 time to create 1 rle with new method : 0.7000846862792969 time for calcul the mask position with numpy : 0.033154964447021484 nb_pixel_total : 18880 time to create 1 rle with old method : 0.02145695686340332 time for calcul the mask position with numpy : 0.03360176086425781 nb_pixel_total : 28008 time to create 1 rle with old method : 0.03385639190673828 time for calcul the mask position with numpy : 0.03382229804992676 nb_pixel_total : 108575 time to create 1 rle with old method : 0.12173581123352051 time for calcul the mask position with numpy : 0.03201794624328613 nb_pixel_total : 21437 time to create 1 rle with old method : 0.023648500442504883 time for calcul the mask position with numpy : 0.03255629539489746 nb_pixel_total : 59682 time to create 1 rle with old method : 0.06790852546691895 time for calcul the mask position with numpy : 0.03316617012023926 nb_pixel_total : 62729 time to create 1 rle with old method : 0.07256388664245605 time for calcul the mask position with numpy : 0.03394794464111328 nb_pixel_total : 20316 time to create 1 rle with old method : 0.023364543914794922 time for calcul the mask position with numpy : 0.03462672233581543 nb_pixel_total : 95945 time to create 1 rle with old method : 0.11149382591247559 time for calcul the mask position with numpy : 0.03277087211608887 nb_pixel_total : 32598 time to create 1 rle with old method : 0.03627514839172363 time for calcul the mask position with numpy : 0.03274941444396973 nb_pixel_total : 62949 time to create 1 rle with old method : 0.07095742225646973 time for calcul the mask position with numpy : 0.032984256744384766 nb_pixel_total : 30209 time to create 1 rle with old method : 0.03414344787597656 time for calcul the mask position with numpy : 0.032913923263549805 nb_pixel_total : 11743 time to create 1 rle with old method : 0.013127326965332031 time for calcul the mask position with numpy : 0.032663583755493164 nb_pixel_total : 79821 time to create 1 rle with old method : 0.08755779266357422 time for calcul the mask position with numpy : 0.032225608825683594 nb_pixel_total : 58386 time to create 1 rle with old method : 0.0639803409576416 time for calcul the mask position with numpy : 0.03213334083557129 nb_pixel_total : 62721 time to create 1 rle with old method : 0.06839632987976074 time for calcul the mask position with numpy : 0.031975746154785156 nb_pixel_total : 16012 time to create 1 rle with old method : 0.017363786697387695 time for calcul the mask position with numpy : 0.031835079193115234 nb_pixel_total : 10262 time to create 1 rle with old method : 0.011603116989135742 time for calcul the mask position with numpy : 0.038652896881103516 nb_pixel_total : 20426 time to create 1 rle with old method : 0.03316974639892578 time for calcul the mask position with numpy : 0.03637409210205078 nb_pixel_total : 57429 time to create 1 rle with old method : 0.06389546394348145 time for calcul the mask position with numpy : 0.032659292221069336 nb_pixel_total : 58663 time to create 1 rle with old method : 0.06524157524108887 time for calcul the mask position with numpy : 0.03230166435241699 nb_pixel_total : 60251 time to create 1 rle with old method : 0.06732487678527832 time for calcul the mask position with numpy : 0.03315258026123047 nb_pixel_total : 48846 time to create 1 rle with old method : 0.05471301078796387 time for calcul the mask position with numpy : 0.03318619728088379 nb_pixel_total : 22101 time to create 1 rle with old method : 0.025258779525756836 time for calcul the mask position with numpy : 0.03311514854431152 nb_pixel_total : 28036 time to create 1 rle with old method : 0.03188490867614746 time for calcul the mask position with numpy : 0.03251814842224121 nb_pixel_total : 69080 time to create 1 rle with old method : 0.0783228874206543 time for calcul the mask position with numpy : 0.0329442024230957 nb_pixel_total : 61970 time to create 1 rle with old method : 0.06844425201416016 time for calcul the mask position with numpy : 0.032410621643066406 nb_pixel_total : 9685 time to create 1 rle with old method : 0.011144399642944336 time for calcul the mask position with numpy : 0.032698631286621094 nb_pixel_total : 27165 time to create 1 rle with old method : 0.031198978424072266 time for calcul the mask position with numpy : 0.03435468673706055 nb_pixel_total : 24297 time to create 1 rle with old method : 0.03999757766723633 time for calcul the mask position with numpy : 0.03815817832946777 nb_pixel_total : 21695 time to create 1 rle with old method : 0.02564835548400879 time for calcul the mask position with numpy : 0.03458237648010254 nb_pixel_total : 67890 time to create 1 rle with old method : 0.07685184478759766 time for calcul the mask position with numpy : 0.033605098724365234 nb_pixel_total : 23786 time to create 1 rle with old method : 0.027110576629638672 create new chi : 4.126742601394653 time to delete rle : 0.002278566360473633 batch 1 Loaded 65 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 18374 TO DO : save crop sub photo not yet done ! save time : 11.660160541534424 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 7.0376176834106445 time for calcul the mask position with numpy : 0.3862779140472412 nb_pixel_total : 7524924 time to create 1 rle with new method : 1.1347615718841553 time for calcul the mask position with numpy : 0.04701590538024902 nb_pixel_total : 167145 time to create 1 rle with new method : 0.7792108058929443 time for calcul the mask position with numpy : 0.03041219711303711 nb_pixel_total : 7015 time to create 1 rle with old method : 0.010341644287109375 time for calcul the mask position with numpy : 0.027426958084106445 nb_pixel_total : 22806 time to create 1 rle with old method : 0.026775836944580078 time for calcul the mask position with numpy : 0.028082847595214844 nb_pixel_total : 76217 time to create 1 rle with old method : 0.09229469299316406 time for calcul the mask position with numpy : 0.02950453758239746 nb_pixel_total : 15941 time to create 1 rle with old method : 0.019340991973876953 time for calcul the mask position with numpy : 0.028873205184936523 nb_pixel_total : 134642 time to create 1 rle with old method : 0.1712172031402588 time for calcul the mask position with numpy : 0.0407865047454834 nb_pixel_total : 22121 time to create 1 rle with old method : 0.02570056915283203 time for calcul the mask position with numpy : 0.041051626205444336 nb_pixel_total : 21110 time to create 1 rle with old method : 0.02517414093017578 time for calcul the mask position with numpy : 0.039700984954833984 nb_pixel_total : 51219 time to create 1 rle with old method : 0.05996870994567871 time for calcul the mask position with numpy : 0.04070901870727539 nb_pixel_total : 14308 time to create 1 rle with old method : 0.02149367332458496 time for calcul the mask position with numpy : 0.040000200271606445 nb_pixel_total : 15665 time to create 1 rle with old method : 0.01863861083984375 time for calcul the mask position with numpy : 0.042252302169799805 nb_pixel_total : 24237 time to create 1 rle with old method : 0.02881646156311035 time for calcul the mask position with numpy : 0.03793478012084961 nb_pixel_total : 28095 time to create 1 rle with old method : 0.0336759090423584 time for calcul the mask position with numpy : 0.03784346580505371 nb_pixel_total : 64627 time to create 1 rle with old method : 0.07664752006530762 time for calcul the mask position with numpy : 0.04089188575744629 nb_pixel_total : 47706 time to create 1 rle with old method : 0.060335636138916016 time for calcul the mask position with numpy : 0.03916668891906738 nb_pixel_total : 11584 time to create 1 rle with old method : 0.013872623443603516 time for calcul the mask position with numpy : 0.040657758712768555 nb_pixel_total : 45038 time to create 1 rle with old method : 0.0518038272857666 create new chi : 3.8384475708007812 time to delete rle : 0.001998424530029297 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 13401 TO DO : save crop sub photo not yet done ! save time : 1.6407783031463623 map_output_result : {1360738216: (0.0, 'Should be the crop_list due to order', 0), 1360738184: (0.0, 'Should be the crop_list due to order', 0), 1360737892: (0.0, 'Should be the crop_list due to order', 0), 1360737859: (0.0, 'Should be the crop_list due to order', 0), 1360737827: (0.0, 'Should be the crop_list due to order', 0), 1360737797: (0.0, 'Should be the crop_list due to order', 0), 1360737518: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360738216, 1360738184, 1360737892, 1360737859, 1360737827, 1360737797, 1360737518] Looping around the photos to save general results len do output : 7 /1360738216.Didn't retrieve data . /1360738184.Didn't retrieve data . /1360737892.Didn't retrieve data . /1360737859.Didn't retrieve data . /1360737827.Didn't retrieve data . /1360737797.Didn't retrieve data . /1360737518.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738216', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738184', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737892', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737859', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737827', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737797', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737518', None, None, None, None, None, '2964617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.01576089859008789 save_final save missing photos in datou_result : time spend for datou_step_exec : 295.91075706481934 time spend to save output : 0.016177892684936523 total time spend for step 3 : 295.9269349575043 step4:ventilate_hashtags_in_portfolio Tue May 27 12:11:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23370994 get user id for portfolio 23370994 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23370994 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','carton','pet_fonce','mal_croppe','environnement','pehd','background','metal','flou','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23370994 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','carton','pet_fonce','mal_croppe','environnement','pehd','background','metal','flou','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23370994 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','carton','pet_fonce','mal_croppe','environnement','pehd','background','metal','flou','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23375547,23375548,23375549,23375550,23375551,23375552,23375553,23375554,23375555,23375556,23375557?tags=pet_clair,papier,carton,pet_fonce,mal_croppe,environnement,pehd,background,metal,flou,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360738216, 1360738184, 1360737892, 1360737859, 1360737827, 1360737797, 1360737518] Looping around the photos to save general results len do output : 1 /23370994. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738216', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738184', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737892', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737859', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737827', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737797', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737518', None, None, None, None, None, '2964617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.03131675720214844 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6874794960021973 time spend to save output : 0.03156447410583496 total time spend for step 4 : 1.7190439701080322 step5:final Tue May 27 12:11:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360738216: ('0.11415013227513227',), 1360738184: ('0.11415013227513227',), 1360737892: ('0.11415013227513227',), 1360737859: ('0.11415013227513227',), 1360737827: ('0.11415013227513227',), 1360737797: ('0.11415013227513227',), 1360737518: ('0.11415013227513227',)} new output for save of step final : {1360738216: ('0.11415013227513227',), 1360738184: ('0.11415013227513227',), 1360737892: ('0.11415013227513227',), 1360737859: ('0.11415013227513227',), 1360737827: ('0.11415013227513227',), 1360737797: ('0.11415013227513227',), 1360737518: ('0.11415013227513227',)} [1360738216, 1360738184, 1360737892, 1360737859, 1360737827, 1360737797, 1360737518] Looping around the photos to save general results len do output : 7 /1360738216.Didn't retrieve data . /1360738184.Didn't retrieve data . /1360737892.Didn't retrieve data . /1360737859.Didn't retrieve data . /1360737827.Didn't retrieve data . /1360737797.Didn't retrieve data . /1360737518.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738216', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738184', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737892', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737859', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737827', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737797', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737518', None, None, None, None, None, '2964617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013705253601074219 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11603331565856934 time spend to save output : 0.014107704162597656 total time spend for step 5 : 0.130141019821167 step6:blur_detection Tue May 27 12:11:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031.jpg resize: (2160, 3840) 1360738216 -6.116249907466045 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769.jpg resize: (2160, 3840) 1360738184 -6.541175973368322 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c.jpg resize: (2160, 3840) 1360737892 -5.7012830946048325 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f.jpg resize: (2160, 3840) 1360737859 -5.979189242602085 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938.jpg resize: (2160, 3840) 1360737827 -5.670813195741335 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578.jpg resize: (2160, 3840) 1360737797 -6.406004523663632 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341.jpg resize: (2160, 3840) 1360737518 -6.4124671006015665 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982430_0.png resize: (247, 223) 1361272100 -3.0677967594443194 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982426_0.png resize: (461, 380) 1361272101 -0.8409851819383044 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982425_0.png resize: (267, 391) 1361272103 -1.8069400976698953 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982439_0.png resize: (378, 230) 1361272104 -3.7054823716663208 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982443_0.png resize: (463, 374) 1361272105 -3.277094049645471 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982437_0.png resize: (119, 118) 1361272106 -4.046777012856923 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982428_0.png resize: (191, 89) 1361272107 -3.1500216408297566 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982438_0.png resize: (195, 221) 1361272108 -3.295494428584509 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982436_0.png resize: (124, 182) 1361272109 -2.7160940068026083 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982434_0.png resize: (154, 146) 1361272110 -2.928475209215799 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982442_0.png resize: (593, 595) 1361272111 -1.766596507580556 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982427_0.png resize: (433, 587) 1361272112 -3.2724607847585174 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982435_0.png resize: (397, 531) 1361272113 -2.4666938878533764 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982444_0.png resize: (185, 174) 1361272115 -3.2714651774249455 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982431_0.png resize: (410, 321) 1361272116 -3.4457290837886876 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982429_0.png resize: (215, 249) 1361272117 -3.2050521876502778 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982432_0.png resize: (216, 157) 1361272118 -2.7225525041816403 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982452_0.png resize: (321, 195) 1361272119 -3.3223521347271414 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982445_0.png resize: (213, 153) 1361272120 0.8793404534619547 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982450_0.png resize: (498, 412) 1361272121 -2.0004252918168874 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982449_0.png resize: (406, 283) 1361272122 -2.2132982523445044 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982464_0.png resize: (217, 206) 1361272123 -4.446387424224265 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982453_0.png resize: (226, 765) 1361272124 -4.214862288172174 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982460_0.png resize: (100, 91) 1361272125 -2.417314420502528 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982461_0.png resize: (137, 115) 1361272126 -4.3663175173288105 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982463_0.png resize: (93, 123) 1361272127 -2.963316183833787 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982465_0.png resize: (200, 349) 1361272128 -0.47343458447017184 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982448_0.png resize: (98, 131) 1361272129 -2.6845873615975897 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982451_0.png resize: (200, 151) 1361272130 -2.3956189725603205 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982456_0.png resize: (392, 642) 1361272131 -1.433494294333363 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982458_0.png resize: (219, 160) 1361272132 -4.274786005739414 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982446_0.png resize: (127, 184) 1361272133 -1.4167947663603087 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982455_0.png resize: (184, 211) 1361272134 -2.840351586024241 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982459_0.png resize: (211, 266) 1361272135 -3.565048505187588 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982447_0.png resize: (347, 355) 1361272136 -3.079988125489209 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982457_0.png resize: (144, 119) 1361272137 -1.4227668064348875 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982462_0.png resize: (242, 221) 1361272138 -2.5784229568610404 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982466_0.png resize: (243, 178) 1361272139 -2.645722772749509 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982468_0.png resize: (338, 306) 1361272140 -2.090837544290361 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982474_0.png resize: (122, 368) 1361272141 -2.221936506234928 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982469_0.png resize: (599, 407) 1361272142 -2.8274816629451984 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982479_0.png resize: (346, 563) 1361272143 -3.9452998939496555 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982482_0.png resize: (203, 212) 1361272144 0.15488659024378373 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982475_0.png resize: (234, 213) 1361272145 -3.071710372603213 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982470_0.png resize: (425, 588) 1361272146 -3.1153159555179957 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982471_0.png resize: (398, 438) 1361272147 -2.003688770631141 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982477_0.png resize: (184, 177) 1361272148 -4.007591475085582 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982467_0.png resize: (223, 264) 1361272149 -2.0420975294809054 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982478_0.png resize: (709, 457) 1361272150 -4.605469302243285 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982494_0.png resize: (291, 252) 1361272151 -3.5208177204602555 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982498_0.png resize: (141, 131) 1361272152 -4.241885720493924 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982486_0.png resize: (311, 133) 1361272153 -1.01332419213867 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982490_0.png resize: (220, 200) 1361272154 -2.3166343371389306 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982484_0.png resize: (392, 354) 1361272155 -0.9705601372446443 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982492_0.png resize: (168, 229) 1361272156 -0.06876969444301569 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982485_0.png resize: (288, 292) 1361272157 2.5512231640088614 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982488_0.png resize: (409, 366) 1361272158 -3.649919633416594 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982487_0.png resize: (184, 164) 1361272159 -3.0112209137669903 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982495_0.png resize: (172, 158) 1361272160 -1.7807481062329233 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982483_0.png resize: (469, 432) 1361272161 2.194823307540617 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982496_0.png resize: (300, 323) 1361272162 3.74259633994122 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982501_0.png resize: (244, 365) 1361272163 -2.5048835759338846 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982514_0.png resize: (76, 148) 1361272164 -3.92023095060252 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982510_0.png resize: (331, 272) 1361272165 -1.4486810831466652 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982503_0.png resize: (245, 282) 1361272166 -2.1911823167028506 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982499_0.png resize: (263, 307) 1361272167 -1.890587352694734 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982511_0.png resize: (133, 112) 1361272168 -2.0478952627512688 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982520_0.png resize: (262, 181) 1361272169 -1.8882373646668642 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982508_0.png resize: (527, 368) 1361272170 -2.6172247524790895 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982519_0.png resize: (183, 378) 1361272171 -0.7591935400675524 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982517_0.png resize: (626, 180) 1361272172 -4.328286046602418 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982506_0.png resize: (214, 192) 1361272173 0.20214449777636856 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982504_0.png resize: (438, 212) 1361272174 -2.191314809576727 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982509_0.png resize: (164, 174) 1361272175 -2.914386884247764 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982505_0.png resize: (79, 100) 1361272177 -4.077031254275624 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982516_0.png resize: (152, 149) 1361272178 -2.8315440291187626 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982512_0.png resize: (257, 286) 1361272179 -3.0365165917582413 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982513_0.png resize: (109, 104) 1361272180 -3.904116159874795 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982515_0.png resize: (154, 117) 1361272181 -4.286699074947306 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982521_0.png resize: (342, 236) 1361272182 0.3729477846746848 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982551_0.png resize: (323, 220) 1361272183 -4.413412839200908 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982526_0.png resize: (166, 171) 1361272185 1.3096366716490822 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982538_0.png resize: (396, 326) 1361272186 -1.667015355553216 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982539_0.png resize: (282, 352) 1361272187 -1.7828184093827277 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982546_0.png resize: (147, 183) 1361272188 0.5994747287397724 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982523_0.png resize: (156, 361) 1361272189 -2.720281247408649 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982534_0.png resize: (176, 512) 1361272190 -4.096235689730007 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982550_0.png resize: (288, 335) 1361272191 -1.4742992972252396 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982548_0.png resize: (198, 161) 1361272192 -2.94110112783744 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982544_0.png resize: (177, 163) 1361272193 -3.5718487584569276 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982542_0.png resize: (185, 174) 1361272194 -3.4795250961781097 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982545_0.png resize: (116, 126) 1361272195 -2.420128999188881 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982522_0.png resize: (276, 343) 1361272196 -0.5167310479152173 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982527_0.png resize: (133, 118) 1361272197 -3.377863312103186 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982535_0.png resize: (171, 258) 1361272198 -2.6223788397222045 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982552_0.png resize: (307, 383) 1361272199 -1.0849257757414135 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982536_0.png resize: (302, 285) 1361272200 -0.6515722617914762 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982537_0.png resize: (186, 243) 1361272201 -3.858543190973059 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982524_0.png resize: (434, 201) 1361272202 -1.3047103984884465 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982533_0.png resize: (258, 206) 1361272203 -3.0282862951909637 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982541_0.png resize: (321, 439) 1361272204 -3.0193067259208535 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982528_0.png resize: (302, 330) 1361272205 -2.409507142098382 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982547_0.png resize: (310, 309) 1361272206 -3.4567544651138995 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982531_0.png resize: (106, 290) 1361272207 -2.468155475312855 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982532_0.png resize: (254, 167) 1361272209 -1.7646913943391604 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982529_0.png resize: (452, 274) 1361272210 -3.079268782289459 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982525_0.png resize: (224, 170) 1361272211 -0.5142616368134392 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982549_0.png resize: (103, 153) 1361272212 -2.1860623302958726 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982543_0.png resize: (364, 210) 1361272213 -2.127410915362599 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982530_0.png resize: (180, 185) 1361272214 -3.7172369041153224 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982556_0.png resize: (257, 336) 1361272215 -1.8634400499864103 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982564_0.png resize: (544, 577) 1361272216 -0.7419027234545806 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982569_0.png resize: (453, 527) 1361272217 -3.370548311361468 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982553_0.png resize: (362, 193) 1361272218 -2.6111288673981417 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982557_0.png resize: (230, 182) 1361272219 -1.7471993264025958 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982560_0.png resize: (140, 202) 1361272220 -2.0682817227452017 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982563_0.png resize: (193, 216) 1361272221 -3.8229009990833784 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982559_0.png resize: (190, 175) 1361272222 -2.6727599879182082 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982565_0.png resize: (169, 158) 1361272223 -4.03949440915976 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982562_0.png resize: (274, 151) 1361272224 -2.633801275900969 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982555_0.png resize: (433, 300) 1361272225 -3.3084045938003124 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982561_0.png resize: (349, 229) 1361272226 -2.4140156679234646 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982567_0.png resize: (388, 95) 1361272227 -3.8550501945019087 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982440_0.png resize: (211, 160) 1361272236 -3.6077775645947985 treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982454_0.png resize: (347, 481) 1361272237 -4.030118153469737 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982472_0.png resize: (324, 226) 1361272238 -3.5474979803927225 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982481_0.png resize: (138, 90) 1361272239 -4.050827434005207 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982473_0.png resize: (126, 98) 1361272240 -2.8223144060727865 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982491_0.png resize: (105, 162) 1361272241 -1.854775260928424 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982497_0.png resize: (231, 147) 1361272242 -1.8293617733136862 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982493_0.png resize: (79, 63) 1361272243 -1.4090141855870484 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982518_0.png resize: (224, 262) 1361272244 -2.3868146177924077 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982502_0.png resize: (211, 177) 1361272245 -4.261818029012604 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982507_0.png resize: (113, 73) 1361272246 -0.5980528627705715 treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982540_0.png resize: (148, 164) 1361272247 -3.681621572050603 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982558_0.png resize: (225, 159) 1361272248 -1.923545143940506 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982568_0.png resize: (236, 101) 1361272249 -3.6729963649940682 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982554_0.png resize: (180, 112) 1361272250 -4.047632409298992 treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982489_0.png resize: (143, 107) 1361272256 -4.181835137125417 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982433_0.png resize: (222, 466) 1361272263 -3.7047268095775534 treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982441_0.png resize: (339, 185) 1361272264 -2.807555771033229 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982476_0.png resize: (264, 233) 1361272265 -4.940819899759323 treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982480_0.png resize: (394, 541) 1361272266 -3.694327268449655 treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982500_0.png resize: (106, 292) 1361272267 -3.625069716782553 treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982566_0.png resize: (319, 280) 1361272268 -3.0761342741957516 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 152 time used for this insertion : 0.022308349609375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 152 time used for this insertion : 6.871730089187622 save missing photos in datou_result : time spend for datou_step_exec : 34.999008893966675 time spend to save output : 6.899158000946045 total time spend for step 6 : 41.89816689491272 step7:brightness Tue May 27 12:12:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031.jpg treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769.jpg treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c.jpg treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f.jpg treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938.jpg treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578.jpg treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341.jpg treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982430_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982426_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982425_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982439_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982443_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982437_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982428_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982438_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982436_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982434_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982442_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982427_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982435_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982444_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982431_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982429_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982432_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982452_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982445_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982450_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982449_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982464_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982453_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982460_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982461_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982463_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982465_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982448_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982451_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982456_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982458_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982446_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982455_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982459_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982447_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982457_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982462_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982466_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982468_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982474_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982469_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982479_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982482_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982475_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982470_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982471_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982477_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982467_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982478_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982494_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982498_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982486_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982490_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982484_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982492_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982485_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982488_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982487_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982495_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982483_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982496_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982501_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982514_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982510_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982503_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982499_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982511_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982520_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982508_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982519_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982517_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982506_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982504_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982509_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982505_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982516_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982512_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982513_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982515_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982521_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982551_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982526_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982538_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982539_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982546_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982523_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982534_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982550_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982548_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982544_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982542_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982545_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982522_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982527_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982535_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982552_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982536_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982537_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982524_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982533_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982541_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982528_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982547_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982531_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982532_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982529_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982525_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982549_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982543_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982530_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982556_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982564_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982569_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982553_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982557_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982560_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982563_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982559_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982565_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982562_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982555_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982561_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982567_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982440_0.png treat image : temp/1748340029_115343_1360738184_d5a7d6a7575f25bb99f510a45ae56769_rle_crop_3813982454_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982472_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982481_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982473_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982491_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982497_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982493_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982518_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982502_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982507_0.png treat image : temp/1748340029_115343_1360737797_550708478e2309a98acfb3234d17c578_rle_crop_3813982540_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982558_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982568_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982554_0.png treat image : temp/1748340029_115343_1360737859_99576c0c8b8d57f3b08a6f604ce4319f_rle_crop_3813982489_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982433_0.png treat image : temp/1748340029_115343_1360738216_7b3a496d6e8903ecf1379feaacd32031_rle_crop_3813982441_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982476_0.png treat image : temp/1748340029_115343_1360737892_b3d0ab466d37d5c87b2c0c35e8544e2c_rle_crop_3813982480_0.png treat image : temp/1748340029_115343_1360737827_e58dd2f341e5d1f5502c8b899ae8f938_rle_crop_3813982500_0.png treat image : temp/1748340029_115343_1360737518_31795b0f64ef152e618cb750bbafe341_rle_crop_3813982566_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 152 time used for this insertion : 0.03384709358215332 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 152 time used for this insertion : 9.141876935958862 save missing photos in datou_result : time spend for datou_step_exec : 9.79915738105774 time spend to save output : 9.18251347541809 total time spend for step 7 : 18.98167085647583 step8:velours_tree Tue May 27 12:12:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.20446300506591797 time spend to save output : 4.6253204345703125e-05 total time spend for step 8 : 0.20450925827026367 step9:send_mail_cod Tue May 27 12:12:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23370994_27-05-2025_12_12_45.pdf 23375547 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233755471748340765 23375548 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233755481748340765 23375549 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233755491748340767 23375550 imagette233755501748340768 23375551 imagette233755511748340768 23375553 imagette233755531748340768 23375554 imagette233755541748340768 23375555 change filename to text .imagette233755551748340768 23375556 imagette233755561748340768 23375557 change filename to text .imagette233755571748340768 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23370994 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23375547,23375548,23375549,23375550,23375551,23375552,23375553,23375554,23375555,23375556,23375557?tags=pet_clair,papier,carton,pet_fonce,mal_croppe,environnement,pehd,background,metal,flou,autre args[1360738216] : ((1360738216, -6.116249907466045, 492609224), (1360738216, 1.460039930739285, 2107752395), '0.11415013227513227') We are sending mail with results at report@fotonower.com args[1360738184] : ((1360738184, -6.541175973368322, 492609224), (1360738184, 1.3416142420955899, 2107752395), '0.11415013227513227') We are sending mail with results at report@fotonower.com args[1360737892] : ((1360737892, -5.7012830946048325, 492609224), (1360737892, 0.7637235307015292, 2107752395), '0.11415013227513227') We are sending mail with results at report@fotonower.com args[1360737859] : ((1360737859, -5.979189242602085, 492609224), (1360737859, 1.6046715048247566, 2107752395), '0.11415013227513227') We are sending mail with results at report@fotonower.com args[1360737827] : ((1360737827, -5.670813195741335, 492609224), (1360737827, 0.658027189356527, 2107752395), '0.11415013227513227') We are sending mail with results at report@fotonower.com args[1360737797] : ((1360737797, -6.406004523663632, 492609224), (1360737797, 1.3367378595127668, 2107752395), '0.11415013227513227') We are sending mail with results at report@fotonower.com args[1360737518] : ((1360737518, -6.4124671006015665, 492609224), (1360737518, 1.426924048208378, 2107752395), '0.11415013227513227') We are sending mail with results at report@fotonower.com refus_total : 0.11415013227513227 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23370994 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23370994_27-05-2025_12_12_45.pdf results_Auto_P23370994_27-05-2025_12_12_45.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23370994_27-05-2025_12_12_45.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23370994','results_Auto_P23370994_27-05-2025_12_12_45.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23370994_27-05-2025_12_12_45.pdf','pdf','','0.48','0.11415013227513227') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23370994

https://www.fotonower.com/image?json=false&list_photos_id=1360738216
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360738184
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360737892
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360737859
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360737827
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360737797
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360737518
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.42%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/23375547?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23375548?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23375549?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23375555?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23375557?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23370994_27-05-2025_12_12_45.pdf.

Lien vers velours :https://www.fotonower.com/velours/23375547,23375548,23375549,23375550,23375551,23375552,23375553,23375554,23375555,23375556,23375557?tags=pet_clair,papier,carton,pet_fonce,mal_croppe,environnement,pehd,background,metal,flou,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 27 May 2025 10:12:50 GMT Content-Length: 0 Connection: close X-Message-Id: jsJHPhjoQ127tIexqIevVg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360738216, 1360738184, 1360737892, 1360737859, 1360737827, 1360737797, 1360737518] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738216', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738184', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737892', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737859', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737827', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737797', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737518', None, None, None, None, None, '2964617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.02857661247253418 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.721608638763428 time spend to save output : 0.028783082962036133 total time spend for step 9 : 5.750391721725464 step10:split_time_score Tue May 27 12:12:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 23052025 23370994 Nombre de photos uploadées : 7 / 23040 (0%) 23052025 23370994 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 23052025 23370994 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0002906322479248047 elapsed_time : insert_dashboard_record_day_entry 0.023862123489379883 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23370864 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23370869 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23370910 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23370920 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23370929 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23370974 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23370979 order by id desc limit 1 Qualite : 0.11415013227513227 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23370994_27-05-2025_12_12_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23370994 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23370994 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371002 order by id desc limit 1 Qualite : 0.11478374495052658 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23371004_27-05-2025_11_12_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371004 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23371004 AND mptpi.`type`=3594 To do Qualite : 0.20263053988233026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23371013_27-05-2025_11_01_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371013 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23371013 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371159 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371208 order by id desc limit 1 Qualite : 0.11329729094328704 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23371209_27-05-2025_11_32_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371209 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23371209 AND mptpi.`type`=3594 To do Qualite : 0.11686973138503085 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23371232_27-05-2025_10_42_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371232 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23371232 AND mptpi.`type`=3594 To do Qualite : 0.1380144779265873 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23333502_26-05-2025_14_25_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23333502 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23333502 AND mptpi.`type`=3594 To do Qualite : 0.1024788804599437 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23333505_26-05-2025_18_36_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23333505 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23333505 AND mptpi.`type`=3594 To do Qualite : 0.12909760400591566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23333535_26-05-2025_16_04_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23333535 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23333535 AND mptpi.`type`=3594 To do Qualite : 0.1140376036844136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23333560_26-05-2025_13_14_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23333560 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23333560 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'23052025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360738216, 1360738184, 1360737892, 1360737859, 1360737827, 1360737797, 1360737518] Looping around the photos to save general results len do output : 1 /23370994Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738216', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360738184', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737892', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737859', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737827', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737797', None, None, None, None, None, '2964617') ('3318', None, None, None, None, None, None, None, '2964617') ('3318', '23370994', '1360737518', None, None, None, None, None, '2964617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.016855955123901367 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.462234258651733 time spend to save output : 0.01708507537841797 total time spend for step 10 : 9.479319334030151 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 140.68user 146.24system 12:35.56elapsed 37%CPU (0avgtext+0avgdata 4142344maxresident)k 1411016inputs+95752outputs (27236major+13891926minor)pagefaults 0swaps