python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3900909 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2913535'] with mtr_portfolio_ids : ['23180313'] and first list_photo_ids : [] new path : /proc/3900909/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.5396244525909424 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 20 20:50:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-20 20:50:35.341962: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-20 20:50:35.371485: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-20 20:50:35.373332: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd6c4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-20 20:50:35.373386: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-20 20:50:35.376062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-20 20:50:35.521498: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x358cbb10 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-20 20:50:35.521568: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-20 20:50:35.522829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 20:50:35.523287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 20:50:35.526344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 20:50:35.529242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 20:50:35.529987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 20:50:35.532864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 20:50:35.533989: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 20:50:35.538392: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 20:50:35.539728: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 20:50:35.539810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 20:50:35.540464: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 20:50:35.540482: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 20:50:35.540492: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 20:50:35.541728: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5958 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-20 20:50:35.849030: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 20:50:35.849142: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 20:50:35.849162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 20:50:35.849180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 20:50:35.849194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 20:50:35.849209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 20:50:35.849224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 20:50:35.849239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 20:50:35.850696: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 20:50:35.851979: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 20:50:35.852057: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 20:50:35.852075: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 20:50:35.852090: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 20:50:35.852104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 20:50:35.852118: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 20:50:35.852132: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 20:50:35.852147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 20:50:35.853207: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 20:50:35.853245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 20:50:35.853256: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 20:50:35.853264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 20:50:35.854424: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5958 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/m2025-05-20 20:50:49.367994: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 20:50:49.623382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 20:50:50.979107: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-20 20:50:50.993544: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-20 20:50:55.453698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.454643: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.455528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.456371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.457203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.458034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.458930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.458974: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 20:50:55.459861: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.459883: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 20:50:55.467599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.467629: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 20:50:55.468491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 20:50:55.468510: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB wNone max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6595 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0007736682891845703 nb_pixel_total : 17910 time to create 1 rle with old method : 0.02093219757080078 length of segment : 126 time for calcul the mask position with numpy : 0.002319812774658203 nb_pixel_total : 91137 time to create 1 rle with old method : 0.10535621643066406 length of segment : 352 time for calcul the mask position with numpy : 0.0038514137268066406 nb_pixel_total : 138434 time to create 1 rle with old method : 0.18333840370178223 length of segment : 530 time for calcul the mask position with numpy : 0.00038695335388183594 nb_pixel_total : 16029 time to create 1 rle with old method : 0.019411802291870117 length of segment : 191 time for calcul the mask position with numpy : 0.0007617473602294922 nb_pixel_total : 39729 time to create 1 rle with old method : 0.04741716384887695 length of segment : 192 time for calcul the mask position with numpy : 0.001172780990600586 nb_pixel_total : 28258 time to create 1 rle with old method : 0.04635214805603027 length of segment : 259 time for calcul the mask position with numpy : 0.000461578369140625 nb_pixel_total : 15246 time to create 1 rle with old method : 0.02289414405822754 length of segment : 179 time for calcul the mask position with numpy : 0.0004515647888183594 nb_pixel_total : 14192 time to create 1 rle with old method : 0.0203704833984375 length of segment : 183 time for calcul the mask position with numpy : 0.0003743171691894531 nb_pixel_total : 17974 time to create 1 rle with old method : 0.023322582244873047 length of segment : 228 time for calcul the mask position with numpy : 0.0026214122772216797 nb_pixel_total : 123048 time to create 1 rle with old method : 0.16030430793762207 length of segment : 662 time for calcul the mask position with numpy : 0.0031769275665283203 nb_pixel_total : 173814 time to create 1 rle with new method : 0.011092424392700195 length of segment : 381 time for calcul the mask position with numpy : 0.0007483959197998047 nb_pixel_total : 33170 time to create 1 rle with old method : 0.040180206298828125 length of segment : 266 time for calcul the mask position with numpy : 0.0020570755004882812 nb_pixel_total : 91454 time to create 1 rle with old method : 0.11852049827575684 length of segment : 490 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 13764 time to create 1 rle with old method : 0.016266584396362305 length of segment : 204 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 20825 time to create 1 rle with old method : 0.03261566162109375 length of segment : 117 time for calcul the mask position with numpy : 0.00039076805114746094 nb_pixel_total : 22129 time to create 1 rle with old method : 0.030357837677001953 length of segment : 124 time for calcul the mask position with numpy : 0.00043463706970214844 nb_pixel_total : 20928 time to create 1 rle with old method : 0.024976730346679688 length of segment : 210 time for calcul the mask position with numpy : 0.0010476112365722656 nb_pixel_total : 64166 time to create 1 rle with old method : 0.07570672035217285 length of segment : 449 time for calcul the mask position with numpy : 0.0020744800567626953 nb_pixel_total : 98972 time to create 1 rle with old method : 0.11664533615112305 length of segment : 375 time for calcul the mask position with numpy : 0.00483250617980957 nb_pixel_total : 145056 time to create 1 rle with old method : 0.16766571998596191 length of segment : 438 time for calcul the mask position with numpy : 0.0030074119567871094 nb_pixel_total : 110158 time to create 1 rle with old method : 0.12810945510864258 length of segment : 442 time for calcul the mask position with numpy : 0.0025758743286132812 nb_pixel_total : 95815 time to create 1 rle with old method : 0.10952281951904297 length of segment : 508 time for calcul the mask position with numpy : 0.0007159709930419922 nb_pixel_total : 27039 time to create 1 rle with old method : 0.03203392028808594 length of segment : 196 time for calcul the mask position with numpy : 0.0025947093963623047 nb_pixel_total : 58321 time to create 1 rle with old method : 0.06626629829406738 length of segment : 461 time for calcul the mask position with numpy : 0.0017311573028564453 nb_pixel_total : 80206 time to create 1 rle with old method : 0.09004831314086914 length of segment : 387 time for calcul the mask position with numpy : 0.0014715194702148438 nb_pixel_total : 56654 time to create 1 rle with old method : 0.06870841979980469 length of segment : 245 time for calcul the mask position with numpy : 0.0013976097106933594 nb_pixel_total : 46248 time to create 1 rle with old method : 0.05490541458129883 length of segment : 316 time for calcul the mask position with numpy : 0.0006263256072998047 nb_pixel_total : 17637 time to create 1 rle with old method : 0.02134871482849121 length of segment : 160 time for calcul the mask position with numpy : 0.0004417896270751953 nb_pixel_total : 12014 time to create 1 rle with old method : 0.014651060104370117 length of segment : 111 time for calcul the mask position with numpy : 0.0020682811737060547 nb_pixel_total : 66948 time to create 1 rle with old method : 0.0777289867401123 length of segment : 321 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 12926 time to create 1 rle with old method : 0.01543116569519043 length of segment : 171 time for calcul the mask position with numpy : 0.0007259845733642578 nb_pixel_total : 18128 time to create 1 rle with old method : 0.021709442138671875 length of segment : 205 time for calcul the mask position with numpy : 0.000942230224609375 nb_pixel_total : 25298 time to create 1 rle with old method : 0.03008294105529785 length of segment : 178 time for calcul the mask position with numpy : 0.0007612705230712891 nb_pixel_total : 20460 time to create 1 rle with old method : 0.024605512619018555 length of segment : 161 time for calcul the mask position with numpy : 0.0005774497985839844 nb_pixel_total : 21422 time to create 1 rle with old method : 0.025133132934570312 length of segment : 331 time for calcul the mask position with numpy : 0.0009543895721435547 nb_pixel_total : 21537 time to create 1 rle with old method : 0.02527451515197754 length of segment : 256 time for calcul the mask position with numpy : 0.0009248256683349609 nb_pixel_total : 30397 time to create 1 rle with old method : 0.03594517707824707 length of segment : 274 time for calcul the mask position with numpy : 0.002814769744873047 nb_pixel_total : 89216 time to create 1 rle with old method : 0.12093520164489746 length of segment : 313 time for calcul the mask position with numpy : 0.0025794506072998047 nb_pixel_total : 57956 time to create 1 rle with old method : 0.06753301620483398 length of segment : 315 time for calcul the mask position with numpy : 0.0025451183319091797 nb_pixel_total : 83802 time to create 1 rle with old method : 0.09486722946166992 length of segment : 388 time for calcul the mask position with numpy : 0.0012631416320800781 nb_pixel_total : 21539 time to create 1 rle with old method : 0.025315523147583008 length of segment : 211 time for calcul the mask position with numpy : 0.0011234283447265625 nb_pixel_total : 32155 time to create 1 rle with old method : 0.03847646713256836 length of segment : 212 time for calcul the mask position with numpy : 0.001963376998901367 nb_pixel_total : 29597 time to create 1 rle with old method : 0.03452491760253906 length of segment : 363 time for calcul the mask position with numpy : 0.0004546642303466797 nb_pixel_total : 9783 time to create 1 rle with old method : 0.011923789978027344 length of segment : 105 time for calcul the mask position with numpy : 0.0033402442932128906 nb_pixel_total : 105075 time to create 1 rle with old method : 0.11962223052978516 length of segment : 418 time for calcul the mask position with numpy : 0.007707118988037109 nb_pixel_total : 163659 time to create 1 rle with new method : 0.01751399040222168 length of segment : 680 time for calcul the mask position with numpy : 0.0037081241607666016 nb_pixel_total : 93546 time to create 1 rle with old method : 0.11902713775634766 length of segment : 425 time for calcul the mask position with numpy : 0.0016205310821533203 nb_pixel_total : 54344 time to create 1 rle with old method : 0.07099461555480957 length of segment : 299 time for calcul the mask position with numpy : 0.00036787986755371094 nb_pixel_total : 5282 time to create 1 rle with old method : 0.00908041000366211 length of segment : 98 time for calcul the mask position with numpy : 0.00020051002502441406 nb_pixel_total : 8405 time to create 1 rle with old method : 0.010038375854492188 length of segment : 156 time for calcul the mask position with numpy : 0.0018911361694335938 nb_pixel_total : 56883 time to create 1 rle with old method : 0.06989693641662598 length of segment : 304 time for calcul the mask position with numpy : 0.002129077911376953 nb_pixel_total : 58596 time to create 1 rle with old method : 0.06993317604064941 length of segment : 189 time for calcul the mask position with numpy : 0.002136707305908203 nb_pixel_total : 72183 time to create 1 rle with old method : 0.10957002639770508 length of segment : 293 time for calcul the mask position with numpy : 0.0019974708557128906 nb_pixel_total : 63068 time to create 1 rle with old method : 0.0734109878540039 length of segment : 425 time for calcul the mask position with numpy : 0.0028891563415527344 nb_pixel_total : 83125 time to create 1 rle with old method : 0.11235690116882324 length of segment : 270 time for calcul the mask position with numpy : 0.0010843276977539062 nb_pixel_total : 29003 time to create 1 rle with old method : 0.03416633605957031 length of segment : 208 time for calcul the mask position with numpy : 0.0036826133728027344 nb_pixel_total : 98039 time to create 1 rle with old method : 0.11316943168640137 length of segment : 322 time for calcul the mask position with numpy : 0.003740072250366211 nb_pixel_total : 83750 time to create 1 rle with old method : 0.09574699401855469 length of segment : 360 time for calcul the mask position with numpy : 0.0018091201782226562 nb_pixel_total : 45182 time to create 1 rle with old method : 0.05260348320007324 length of segment : 261 time for calcul the mask position with numpy : 0.0005831718444824219 nb_pixel_total : 10052 time to create 1 rle with old method : 0.012217283248901367 length of segment : 110 time for calcul the mask position with numpy : 0.0016338825225830078 nb_pixel_total : 36662 time to create 1 rle with old method : 0.042662858963012695 length of segment : 183 time for calcul the mask position with numpy : 0.0018544197082519531 nb_pixel_total : 40396 time to create 1 rle with old method : 0.0474698543548584 length of segment : 298 time for calcul the mask position with numpy : 0.003887653350830078 nb_pixel_total : 93764 time to create 1 rle with old method : 0.10750627517700195 length of segment : 355 time for calcul the mask position with numpy : 0.0022313594818115234 nb_pixel_total : 59866 time to create 1 rle with old method : 0.06920051574707031 length of segment : 237 time for calcul the mask position with numpy : 0.0010387897491455078 nb_pixel_total : 30380 time to create 1 rle with old method : 0.03599834442138672 length of segment : 221 time for calcul the mask position with numpy : 0.002935171127319336 nb_pixel_total : 42575 time to create 1 rle with old method : 0.050130605697631836 length of segment : 300 time for calcul the mask position with numpy : 0.0022199153900146484 nb_pixel_total : 69274 time to create 1 rle with old method : 0.08157730102539062 length of segment : 240 time for calcul the mask position with numpy : 0.0008442401885986328 nb_pixel_total : 13468 time to create 1 rle with old method : 0.016412973403930664 length of segment : 171 time for calcul the mask position with numpy : 0.004145145416259766 nb_pixel_total : 117418 time to create 1 rle with old method : 0.1469123363494873 length of segment : 345 time for calcul the mask position with numpy : 0.004203081130981445 nb_pixel_total : 131171 time to create 1 rle with old method : 0.1496889591217041 length of segment : 364 time for calcul the mask position with numpy : 0.0077016353607177734 nb_pixel_total : 197545 time to create 1 rle with new method : 0.016962289810180664 length of segment : 1128 time for calcul the mask position with numpy : 0.004279613494873047 nb_pixel_total : 87708 time to create 1 rle with old method : 0.10187101364135742 length of segment : 400 time for calcul the mask position with numpy : 0.0009295940399169922 nb_pixel_total : 21711 time to create 1 rle with old method : 0.025803804397583008 length of segment : 455 time for calcul the mask position with numpy : 0.002355813980102539 nb_pixel_total : 43690 time to create 1 rle with old method : 0.051184892654418945 length of segment : 302 time for calcul the mask position with numpy : 0.0008051395416259766 nb_pixel_total : 24497 time to create 1 rle with old method : 0.029236316680908203 length of segment : 197 time for calcul the mask position with numpy : 0.0010335445404052734 nb_pixel_total : 30528 time to create 1 rle with old method : 0.03679776191711426 length of segment : 268 time for calcul the mask position with numpy : 0.0017085075378417969 nb_pixel_total : 67300 time to create 1 rle with old method : 0.07885241508483887 length of segment : 238 time for calcul the mask position with numpy : 0.00043892860412597656 nb_pixel_total : 9017 time to create 1 rle with old method : 0.012222528457641602 length of segment : 119 time for calcul the mask position with numpy : 0.0017576217651367188 nb_pixel_total : 56349 time to create 1 rle with old method : 0.06691145896911621 length of segment : 265 time for calcul the mask position with numpy : 0.003078460693359375 nb_pixel_total : 119818 time to create 1 rle with old method : 0.13943123817443848 length of segment : 316 time for calcul the mask position with numpy : 0.0009026527404785156 nb_pixel_total : 22260 time to create 1 rle with old method : 0.0264434814453125 length of segment : 334 time for calcul the mask position with numpy : 0.002058744430541992 nb_pixel_total : 52655 time to create 1 rle with old method : 0.06145977973937988 length of segment : 338 time for calcul the mask position with numpy : 0.0020003318786621094 nb_pixel_total : 39372 time to create 1 rle with old method : 0.047278404235839844 length of segment : 261 time for calcul the mask position with numpy : 0.005307435989379883 nb_pixel_total : 82812 time to create 1 rle with old method : 0.09697651863098145 length of segment : 559 time for calcul the mask position with numpy : 0.0005695819854736328 nb_pixel_total : 7785 time to create 1 rle with old method : 0.009473323822021484 length of segment : 146 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 5722 time to create 1 rle with old method : 0.006981372833251953 length of segment : 101 time for calcul the mask position with numpy : 0.005089521408081055 nb_pixel_total : 120537 time to create 1 rle with old method : 0.15482592582702637 length of segment : 279 time for calcul the mask position with numpy : 0.001355886459350586 nb_pixel_total : 27909 time to create 1 rle with old method : 0.033084869384765625 length of segment : 182 time for calcul the mask position with numpy : 0.003968715667724609 nb_pixel_total : 115735 time to create 1 rle with old method : 0.13417959213256836 length of segment : 396 time for calcul the mask position with numpy : 0.0009849071502685547 nb_pixel_total : 22336 time to create 1 rle with old method : 0.026224136352539062 length of segment : 238 time for calcul the mask position with numpy : 0.0008356571197509766 nb_pixel_total : 14515 time to create 1 rle with old method : 0.017012357711791992 length of segment : 166 time for calcul the mask position with numpy : 0.0008609294891357422 nb_pixel_total : 29053 time to create 1 rle with old method : 0.03476881980895996 length of segment : 132 time for calcul the mask position with numpy : 0.0008833408355712891 nb_pixel_total : 22375 time to create 1 rle with old method : 0.02727055549621582 length of segment : 114 time for calcul the mask position with numpy : 0.0022745132446289062 nb_pixel_total : 50633 time to create 1 rle with old method : 0.05976414680480957 length of segment : 283 time for calcul the mask position with numpy : 0.0013327598571777344 nb_pixel_total : 34005 time to create 1 rle with old method : 0.042406320571899414 length of segment : 223 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 8670 time to create 1 rle with old method : 0.010616540908813477 length of segment : 119 time for calcul the mask position with numpy : 0.0005047321319580078 nb_pixel_total : 12493 time to create 1 rle with old method : 0.01511240005493164 length of segment : 110 time for calcul the mask position with numpy : 0.0033173561096191406 nb_pixel_total : 72793 time to create 1 rle with old method : 0.08457756042480469 length of segment : 423 time for calcul the mask position with numpy : 0.002004861831665039 nb_pixel_total : 32046 time to create 1 rle with old method : 0.03794240951538086 length of segment : 325 time for calcul the mask position with numpy : 0.0005452632904052734 nb_pixel_total : 8618 time to create 1 rle with old method : 0.010376453399658203 length of segment : 157 time for calcul the mask position with numpy : 0.0005602836608886719 nb_pixel_total : 10352 time to create 1 rle with old method : 0.012423276901245117 length of segment : 105 time for calcul the mask position with numpy : 0.0017459392547607422 nb_pixel_total : 23762 time to create 1 rle with old method : 0.028510332107543945 length of segment : 349 time for calcul the mask position with numpy : 0.00399470329284668 nb_pixel_total : 145236 time to create 1 rle with old method : 0.16659069061279297 length of segment : 391 time for calcul the mask position with numpy : 0.0021123886108398438 nb_pixel_total : 41799 time to create 1 rle with old method : 0.059114933013916016 length of segment : 810 time for calcul the mask position with numpy : 0.0008611679077148438 nb_pixel_total : 31483 time to create 1 rle with old method : 0.04070305824279785 length of segment : 443 time for calcul the mask position with numpy : 0.001377105712890625 nb_pixel_total : 31431 time to create 1 rle with old method : 0.04397988319396973 length of segment : 190 time for calcul the mask position with numpy : 0.0010783672332763672 nb_pixel_total : 32004 time to create 1 rle with old method : 0.0386347770690918 length of segment : 226 time for calcul the mask position with numpy : 0.0009603500366210938 nb_pixel_total : 22689 time to create 1 rle with old method : 0.029597997665405273 length of segment : 235 time for calcul the mask position with numpy : 0.0013930797576904297 nb_pixel_total : 44816 time to create 1 rle with old method : 0.05302762985229492 length of segment : 291 time for calcul the mask position with numpy : 0.0008647441864013672 nb_pixel_total : 22943 time to create 1 rle with old method : 0.027082204818725586 length of segment : 202 time for calcul the mask position with numpy : 0.0015597343444824219 nb_pixel_total : 40318 time to create 1 rle with old method : 0.046994686126708984 length of segment : 263 time for calcul the mask position with numpy : 0.0008709430694580078 nb_pixel_total : 20175 time to create 1 rle with old method : 0.02387523651123047 length of segment : 254 time for calcul the mask position with numpy : 0.00041103363037109375 nb_pixel_total : 7076 time to create 1 rle with old method : 0.008746862411499023 length of segment : 106 time for calcul the mask position with numpy : 0.0011191368103027344 nb_pixel_total : 33237 time to create 1 rle with old method : 0.039071083068847656 length of segment : 274 time for calcul the mask position with numpy : 0.0021271705627441406 nb_pixel_total : 54280 time to create 1 rle with old method : 0.07027387619018555 length of segment : 395 time for calcul the mask position with numpy : 0.0077667236328125 nb_pixel_total : 221105 time to create 1 rle with new method : 0.015158891677856445 length of segment : 686 time for calcul the mask position with numpy : 0.00092315673828125 nb_pixel_total : 29660 time to create 1 rle with old method : 0.03635907173156738 length of segment : 215 time for calcul the mask position with numpy : 0.003291606903076172 nb_pixel_total : 122298 time to create 1 rle with old method : 0.14867115020751953 length of segment : 782 time for calcul the mask position with numpy : 0.004515409469604492 nb_pixel_total : 102162 time to create 1 rle with old method : 0.14060640335083008 length of segment : 723 time for calcul the mask position with numpy : 0.0011641979217529297 nb_pixel_total : 29707 time to create 1 rle with old method : 0.03488326072692871 length of segment : 191 time for calcul the mask position with numpy : 0.003200054168701172 nb_pixel_total : 110455 time to create 1 rle with old method : 0.1265110969543457 length of segment : 520 time spent for convertir_results : 12.719930410385132 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 121 chid ids of type : 3594 Number RLEs to save : 36343 save missing photos in datou_result : time spend for datou_step_exec : 87.46563482284546 time spend to save output : 2.3311190605163574 total time spend for step 1 : 89.79675388336182 step2:crop_condition Tue May 20 20:52:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 121 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 73 About to insert : list_path_to_insert length 73 new photo from crops ! About to upload 73 photos upload in portfolio : 3736932 init cache_photo without model_param we have 73 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747767140_3900909 we have uploaded 73 photos in the portfolio 3736932 time of upload the photos Elapsed time : 22.638186931610107 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747767165_3900909 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7963871955871582 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3736932 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747767183_3900909 we have uploaded 40 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.046357870101929 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747767197_3900909 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7625291347503662 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359829271, 1359829269, 1359829267, 1359829264, 1359829260, 1359829250, 1359829244, 1359829237, 1359829231] Looping around the photos to save general results len do output : 121 /1359856861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359856945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359857055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829271', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829269', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829267', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829264', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829260', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829250', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829244', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829237', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829231', None, None, None, None, None, '2913535') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 372 time used for this insertion : 0.02766108512878418 save_final save missing photos in datou_result : time spend for datou_step_exec : 75.61916041374207 time spend to save output : 0.032761573791503906 total time spend for step 2 : 75.65192198753357 step3:rle_unique_nms_with_priority Tue May 20 20:53:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 121 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1359829271 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 6.919615268707275 time for calcul the mask position with numpy : 1.395742654800415 nb_pixel_total : 7494083 time to create 1 rle with new method : 1.0853943824768066 time for calcul the mask position with numpy : 0.04096055030822754 nb_pixel_total : 91376 time to create 1 rle with old method : 0.10123229026794434 time for calcul the mask position with numpy : 0.02640557289123535 nb_pixel_total : 33170 time to create 1 rle with old method : 0.03735160827636719 time for calcul the mask position with numpy : 0.02649712562561035 nb_pixel_total : 173814 time to create 1 rle with new method : 0.883265495300293 time for calcul the mask position with numpy : 0.027135848999023438 nb_pixel_total : 123048 time to create 1 rle with old method : 0.13807344436645508 time for calcul the mask position with numpy : 0.026761770248413086 nb_pixel_total : 17974 time to create 1 rle with old method : 0.020566940307617188 time for calcul the mask position with numpy : 0.02693033218383789 nb_pixel_total : 14192 time to create 1 rle with old method : 0.016369342803955078 time for calcul the mask position with numpy : 0.026686429977416992 nb_pixel_total : 15246 time to create 1 rle with old method : 0.017621994018554688 time for calcul the mask position with numpy : 0.02592778205871582 nb_pixel_total : 28258 time to create 1 rle with old method : 0.03200554847717285 time for calcul the mask position with numpy : 0.02599954605102539 nb_pixel_total : 39729 time to create 1 rle with old method : 0.04495954513549805 time for calcul the mask position with numpy : 0.02693796157836914 nb_pixel_total : 16029 time to create 1 rle with old method : 0.018140077590942383 time for calcul the mask position with numpy : 0.02779364585876465 nb_pixel_total : 138434 time to create 1 rle with old method : 0.16125249862670898 time for calcul the mask position with numpy : 0.027964115142822266 nb_pixel_total : 91137 time to create 1 rle with old method : 0.10260939598083496 time for calcul the mask position with numpy : 0.027739524841308594 nb_pixel_total : 17910 time to create 1 rle with old method : 0.020558595657348633 create new chi : 4.50913405418396 time to delete rle : 0.028130292892456055 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 10210 TO DO : save crop sub photo not yet done ! save time : 0.7058160305023193 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 6.89256739616394 time for calcul the mask position with numpy : 0.990652322769165 nb_pixel_total : 7480367 time to create 1 rle with new method : 1.152726411819458 time for calcul the mask position with numpy : 0.039934635162353516 nb_pixel_total : 56654 time to create 1 rle with old method : 0.06827902793884277 time for calcul the mask position with numpy : 0.026802539825439453 nb_pixel_total : 80206 time to create 1 rle with old method : 0.09064698219299316 time for calcul the mask position with numpy : 0.025832414627075195 nb_pixel_total : 58321 time to create 1 rle with old method : 0.0665581226348877 time for calcul the mask position with numpy : 0.026087284088134766 nb_pixel_total : 27039 time to create 1 rle with old method : 0.029372692108154297 time for calcul the mask position with numpy : 0.025519371032714844 nb_pixel_total : 95815 time to create 1 rle with old method : 0.10703420639038086 time for calcul the mask position with numpy : 0.025643587112426758 nb_pixel_total : 110158 time to create 1 rle with old method : 0.12293791770935059 time for calcul the mask position with numpy : 0.027295827865600586 nb_pixel_total : 145056 time to create 1 rle with old method : 0.16103029251098633 time for calcul the mask position with numpy : 0.02707219123840332 nb_pixel_total : 98972 time to create 1 rle with old method : 0.11210012435913086 time for calcul the mask position with numpy : 0.02628612518310547 nb_pixel_total : 64166 time to create 1 rle with old method : 0.07344532012939453 time for calcul the mask position with numpy : 0.028708696365356445 nb_pixel_total : 20928 time to create 1 rle with old method : 0.02361893653869629 time for calcul the mask position with numpy : 0.026134014129638672 nb_pixel_total : 22129 time to create 1 rle with old method : 0.024682998657226562 time for calcul the mask position with numpy : 0.026119709014892578 nb_pixel_total : 20825 time to create 1 rle with old method : 0.02379441261291504 time for calcul the mask position with numpy : 0.027257204055786133 nb_pixel_total : 13764 time to create 1 rle with old method : 0.015494585037231445 create new chi : 3.465986967086792 time to delete rle : 0.001432180404663086 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 10472 TO DO : save crop sub photo not yet done ! save time : 0.7123727798461914 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 8.447307348251343 time for calcul the mask position with numpy : 0.9529187679290771 nb_pixel_total : 7748914 time to create 1 rle with new method : 0.9972469806671143 time for calcul the mask position with numpy : 0.04403376579284668 nb_pixel_total : 21539 time to create 1 rle with old method : 0.024261474609375 time for calcul the mask position with numpy : 0.04681825637817383 nb_pixel_total : 83802 time to create 1 rle with old method : 0.09537577629089355 time for calcul the mask position with numpy : 0.03965425491333008 nb_pixel_total : 57956 time to create 1 rle with old method : 0.07075262069702148 time for calcul the mask position with numpy : 0.037720680236816406 nb_pixel_total : 89216 time to create 1 rle with old method : 0.09694099426269531 time for calcul the mask position with numpy : 0.035898447036743164 nb_pixel_total : 30397 time to create 1 rle with old method : 0.03392434120178223 time for calcul the mask position with numpy : 0.027484655380249023 nb_pixel_total : 21537 time to create 1 rle with old method : 0.024393796920776367 time for calcul the mask position with numpy : 0.028933048248291016 nb_pixel_total : 21380 time to create 1 rle with old method : 0.023707866668701172 time for calcul the mask position with numpy : 0.025165081024169922 nb_pixel_total : 20460 time to create 1 rle with old method : 0.02301311492919922 time for calcul the mask position with numpy : 0.026840925216674805 nb_pixel_total : 25298 time to create 1 rle with old method : 0.028171062469482422 time for calcul the mask position with numpy : 0.02933526039123535 nb_pixel_total : 18128 time to create 1 rle with old method : 0.022362470626831055 time for calcul the mask position with numpy : 0.0289456844329834 nb_pixel_total : 12926 time to create 1 rle with old method : 0.014848947525024414 time for calcul the mask position with numpy : 0.040038108825683594 nb_pixel_total : 66948 time to create 1 rle with old method : 0.07852602005004883 time for calcul the mask position with numpy : 0.04238772392272949 nb_pixel_total : 12014 time to create 1 rle with old method : 0.013370990753173828 time for calcul the mask position with numpy : 0.03931307792663574 nb_pixel_total : 17637 time to create 1 rle with old method : 0.020140647888183594 time for calcul the mask position with numpy : 0.0408024787902832 nb_pixel_total : 46248 time to create 1 rle with old method : 0.051424503326416016 create new chi : 3.154107093811035 time to delete rle : 0.0014379024505615234 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9512 TO DO : save crop sub photo not yet done ! save time : 0.6512022018432617 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 7.872307062149048 time for calcul the mask position with numpy : 0.6762328147888184 nb_pixel_total : 7458712 time to create 1 rle with new method : 1.1605157852172852 time for calcul the mask position with numpy : 0.025595664978027344 nb_pixel_total : 83125 time to create 1 rle with old method : 0.09267735481262207 time for calcul the mask position with numpy : 0.02448296546936035 nb_pixel_total : 63068 time to create 1 rle with old method : 0.0712888240814209 time for calcul the mask position with numpy : 0.028564453125 nb_pixel_total : 72183 time to create 1 rle with old method : 0.08169245719909668 time for calcul the mask position with numpy : 0.025004863739013672 nb_pixel_total : 58596 time to create 1 rle with old method : 0.06453156471252441 time for calcul the mask position with numpy : 0.024411439895629883 nb_pixel_total : 56883 time to create 1 rle with old method : 0.06306171417236328 time for calcul the mask position with numpy : 0.023687124252319336 nb_pixel_total : 8392 time to create 1 rle with old method : 0.009365320205688477 time for calcul the mask position with numpy : 0.02397918701171875 nb_pixel_total : 5282 time to create 1 rle with old method : 0.006037712097167969 time for calcul the mask position with numpy : 0.02529144287109375 nb_pixel_total : 54344 time to create 1 rle with old method : 0.06000494956970215 time for calcul the mask position with numpy : 0.025289058685302734 nb_pixel_total : 93546 time to create 1 rle with old method : 0.1036672592163086 time for calcul the mask position with numpy : 0.02642369270324707 nb_pixel_total : 163659 time to create 1 rle with new method : 1.0461900234222412 time for calcul the mask position with numpy : 0.02550029754638672 nb_pixel_total : 105075 time to create 1 rle with old method : 0.1144411563873291 time for calcul the mask position with numpy : 0.0256345272064209 nb_pixel_total : 9783 time to create 1 rle with old method : 0.010882377624511719 time for calcul the mask position with numpy : 0.024590015411376953 nb_pixel_total : 29597 time to create 1 rle with old method : 0.032624006271362305 time for calcul the mask position with numpy : 0.0249941349029541 nb_pixel_total : 32155 time to create 1 rle with old method : 0.03610658645629883 create new chi : 4.0619895458221436 time to delete rle : 0.001950979232788086 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 10629 TO DO : save crop sub photo not yet done ! save time : 0.7477014064788818 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 10.508341789245605 time for calcul the mask position with numpy : 0.6318185329437256 nb_pixel_total : 7042746 time to create 1 rle with new method : 0.8170742988586426 time for calcul the mask position with numpy : 0.02686166763305664 nb_pixel_total : 43690 time to create 1 rle with old method : 0.04577016830444336 time for calcul the mask position with numpy : 0.024273395538330078 nb_pixel_total : 21711 time to create 1 rle with old method : 0.026648998260498047 time for calcul the mask position with numpy : 0.02503514289855957 nb_pixel_total : 87708 time to create 1 rle with old method : 0.09391283988952637 time for calcul the mask position with numpy : 0.026819944381713867 nb_pixel_total : 197545 time to create 1 rle with new method : 0.871323823928833 time for calcul the mask position with numpy : 0.0259249210357666 nb_pixel_total : 131171 time to create 1 rle with old method : 0.14316773414611816 time for calcul the mask position with numpy : 0.02473735809326172 nb_pixel_total : 117418 time to create 1 rle with old method : 0.12524628639221191 time for calcul the mask position with numpy : 0.024939537048339844 nb_pixel_total : 13468 time to create 1 rle with old method : 0.014378786087036133 time for calcul the mask position with numpy : 0.0412287712097168 nb_pixel_total : 69274 time to create 1 rle with old method : 0.07443475723266602 time for calcul the mask position with numpy : 0.04073143005371094 nb_pixel_total : 42575 time to create 1 rle with old method : 0.0468442440032959 time for calcul the mask position with numpy : 0.040331363677978516 nb_pixel_total : 30380 time to create 1 rle with old method : 0.03331613540649414 time for calcul the mask position with numpy : 0.04732203483581543 nb_pixel_total : 59866 time to create 1 rle with old method : 0.0668327808380127 time for calcul the mask position with numpy : 0.042350053787231445 nb_pixel_total : 93764 time to create 1 rle with old method : 0.10242295265197754 time for calcul the mask position with numpy : 0.0401005744934082 nb_pixel_total : 40396 time to create 1 rle with old method : 0.04607343673706055 time for calcul the mask position with numpy : 0.042794227600097656 nb_pixel_total : 36662 time to create 1 rle with old method : 0.04101753234863281 time for calcul the mask position with numpy : 0.046750545501708984 nb_pixel_total : 10052 time to create 1 rle with old method : 0.01121973991394043 time for calcul the mask position with numpy : 0.04039955139160156 nb_pixel_total : 45182 time to create 1 rle with old method : 0.05023002624511719 time for calcul the mask position with numpy : 0.040167808532714844 nb_pixel_total : 83750 time to create 1 rle with old method : 0.09236454963684082 time for calcul the mask position with numpy : 0.04069066047668457 nb_pixel_total : 98039 time to create 1 rle with old method : 0.10867166519165039 time for calcul the mask position with numpy : 0.03968238830566406 nb_pixel_total : 29003 time to create 1 rle with old method : 0.04969525337219238 create new chi : 4.256504058837891 time to delete rle : 0.004947185516357422 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 14680 TO DO : save crop sub photo not yet done ! save time : 0.958791971206665 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 6.246125936508179 time for calcul the mask position with numpy : 0.3667910099029541 nb_pixel_total : 7913258 time to create 1 rle with new method : 0.5072836875915527 time for calcul the mask position with numpy : 0.04386305809020996 nb_pixel_total : 52655 time to create 1 rle with old method : 0.0581202507019043 time for calcul the mask position with numpy : 0.041613101959228516 nb_pixel_total : 22260 time to create 1 rle with old method : 0.024758338928222656 time for calcul the mask position with numpy : 0.04317331314086914 nb_pixel_total : 119818 time to create 1 rle with old method : 0.13273239135742188 time for calcul the mask position with numpy : 0.03988838195800781 nb_pixel_total : 56349 time to create 1 rle with old method : 0.06177568435668945 time for calcul the mask position with numpy : 0.03613400459289551 nb_pixel_total : 9017 time to create 1 rle with old method : 0.010936260223388672 time for calcul the mask position with numpy : 0.034609317779541016 nb_pixel_total : 67300 time to create 1 rle with old method : 0.0751490592956543 time for calcul the mask position with numpy : 0.025456666946411133 nb_pixel_total : 29246 time to create 1 rle with old method : 0.033473968505859375 time for calcul the mask position with numpy : 0.024728775024414062 nb_pixel_total : 24497 time to create 1 rle with old method : 0.027555465698242188 create new chi : 1.6394193172454834 time to delete rle : 0.0010178089141845703 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 6182 TO DO : save crop sub photo not yet done ! save time : 0.46942806243896484 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 9.064753532409668 time for calcul the mask position with numpy : 0.9069876670837402 nb_pixel_total : 7566538 time to create 1 rle with new method : 0.75846266746521 time for calcul the mask position with numpy : 0.04013824462890625 nb_pixel_total : 23762 time to create 1 rle with old method : 0.02606654167175293 time for calcul the mask position with numpy : 0.0396425724029541 nb_pixel_total : 10352 time to create 1 rle with old method : 0.011117219924926758 time for calcul the mask position with numpy : 0.03864431381225586 nb_pixel_total : 8618 time to create 1 rle with old method : 0.009442567825317383 time for calcul the mask position with numpy : 0.04488968849182129 nb_pixel_total : 18385 time to create 1 rle with old method : 0.02376103401184082 time for calcul the mask position with numpy : 0.04054141044616699 nb_pixel_total : 72793 time to create 1 rle with old method : 0.10072159767150879 time for calcul the mask position with numpy : 0.04161667823791504 nb_pixel_total : 12493 time to create 1 rle with old method : 0.014184236526489258 time for calcul the mask position with numpy : 0.035674095153808594 nb_pixel_total : 8670 time to create 1 rle with old method : 0.00983572006225586 time for calcul the mask position with numpy : 0.027249574661254883 nb_pixel_total : 34005 time to create 1 rle with old method : 0.038645029067993164 time for calcul the mask position with numpy : 0.02688908576965332 nb_pixel_total : 50633 time to create 1 rle with old method : 0.05658078193664551 time for calcul the mask position with numpy : 0.025360822677612305 nb_pixel_total : 22375 time to create 1 rle with old method : 0.024884939193725586 time for calcul the mask position with numpy : 0.02563619613647461 nb_pixel_total : 29053 time to create 1 rle with old method : 0.032258033752441406 time for calcul the mask position with numpy : 0.024951457977294922 nb_pixel_total : 14515 time to create 1 rle with old method : 0.016440868377685547 time for calcul the mask position with numpy : 0.025196075439453125 nb_pixel_total : 22336 time to create 1 rle with old method : 0.025447607040405273 time for calcul the mask position with numpy : 0.026667356491088867 nb_pixel_total : 115735 time to create 1 rle with old method : 0.13495492935180664 time for calcul the mask position with numpy : 0.02497553825378418 nb_pixel_total : 27909 time to create 1 rle with old method : 0.030530452728271484 time for calcul the mask position with numpy : 0.02506399154663086 nb_pixel_total : 120537 time to create 1 rle with old method : 0.13432598114013672 time for calcul the mask position with numpy : 0.027031660079956055 nb_pixel_total : 5722 time to create 1 rle with old method : 0.006535053253173828 time for calcul the mask position with numpy : 0.026237964630126953 nb_pixel_total : 7785 time to create 1 rle with old method : 0.008875131607055664 time for calcul the mask position with numpy : 0.028055429458618164 nb_pixel_total : 82812 time to create 1 rle with old method : 0.11960530281066895 time for calcul the mask position with numpy : 0.02659749984741211 nb_pixel_total : 39372 time to create 1 rle with old method : 0.04488396644592285 create new chi : 3.204474925994873 time to delete rle : 0.0017902851104736328 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 11271 TO DO : save crop sub photo not yet done ! save time : 0.846203088760376 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 10.249966382980347 time for calcul the mask position with numpy : 0.9825935363769531 nb_pixel_total : 7160398 time to create 1 rle with new method : 1.3947265148162842 time for calcul the mask position with numpy : 0.025875091552734375 nb_pixel_total : 110455 time to create 1 rle with old method : 0.12505054473876953 time for calcul the mask position with numpy : 0.04050588607788086 nb_pixel_total : 29707 time to create 1 rle with old method : 0.03262734413146973 time for calcul the mask position with numpy : 0.04028463363647461 nb_pixel_total : 102162 time to create 1 rle with old method : 0.1103980541229248 time for calcul the mask position with numpy : 0.040964365005493164 nb_pixel_total : 122298 time to create 1 rle with old method : 0.1311330795288086 time for calcul the mask position with numpy : 0.0420985221862793 nb_pixel_total : 29660 time to create 1 rle with old method : 0.03179144859313965 time for calcul the mask position with numpy : 0.04217410087585449 nb_pixel_total : 221105 time to create 1 rle with new method : 1.0102474689483643 time for calcul the mask position with numpy : 0.041954755783081055 nb_pixel_total : 54280 time to create 1 rle with old method : 0.06177520751953125 time for calcul the mask position with numpy : 0.02872633934020996 nb_pixel_total : 33237 time to create 1 rle with old method : 0.03655195236206055 time for calcul the mask position with numpy : 0.025171279907226562 nb_pixel_total : 7076 time to create 1 rle with old method : 0.007905721664428711 time for calcul the mask position with numpy : 0.026864051818847656 nb_pixel_total : 20175 time to create 1 rle with old method : 0.0237579345703125 time for calcul the mask position with numpy : 0.025174617767333984 nb_pixel_total : 40318 time to create 1 rle with old method : 0.04410958290100098 time for calcul the mask position with numpy : 0.025585412979125977 nb_pixel_total : 22943 time to create 1 rle with old method : 0.025087594985961914 time for calcul the mask position with numpy : 0.02485823631286621 nb_pixel_total : 44816 time to create 1 rle with old method : 0.04960370063781738 time for calcul the mask position with numpy : 0.0258333683013916 nb_pixel_total : 22689 time to create 1 rle with old method : 0.02486896514892578 time for calcul the mask position with numpy : 0.02493429183959961 nb_pixel_total : 32004 time to create 1 rle with old method : 0.03533315658569336 time for calcul the mask position with numpy : 0.02532505989074707 nb_pixel_total : 31431 time to create 1 rle with old method : 0.034320831298828125 time for calcul the mask position with numpy : 0.024840831756591797 nb_pixel_total : 22611 time to create 1 rle with old method : 0.025207996368408203 time for calcul the mask position with numpy : 0.02838921546936035 nb_pixel_total : 41799 time to create 1 rle with old method : 0.06717681884765625 time for calcul the mask position with numpy : 0.02818441390991211 nb_pixel_total : 145236 time to create 1 rle with old method : 0.1629490852355957 create new chi : 5.081511735916138 time to delete rle : 0.002227783203125 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 16261 TO DO : save crop sub photo not yet done ! save time : 1.0426318645477295 map_output_result : {1359829271: (0.0, 'Should be the crop_list due to order', 0.0), 1359829269: (0.0, 'Should be the crop_list due to order', 0), 1359829267: (0.0, 'Should be the crop_list due to order', 0), 1359829264: (0.0, 'Should be the crop_list due to order', 0), 1359829260: (0.0, 'Should be the crop_list due to order', 0), 1359829250: (0.0, 'Should be the crop_list due to order', 0), 1359829244: (0.0, 'Should be the crop_list due to order', 0), 1359829237: (0.0, 'Should be the crop_list due to order', 0), 1359829231: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359829271, 1359829269, 1359829267, 1359829264, 1359829260, 1359829250, 1359829244, 1359829237, 1359829231] Looping around the photos to save general results len do output : 9 /1359829271.Didn't retrieve data . /1359829269.Didn't retrieve data . /1359829267.Didn't retrieve data . /1359829264.Didn't retrieve data . /1359829260.Didn't retrieve data . /1359829250.Didn't retrieve data . /1359829244.Didn't retrieve data . /1359829237.Didn't retrieve data . /1359829231.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829271', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829269', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829267', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829264', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829260', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829250', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829244', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829237', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829231', None, None, None, None, None, '2913535') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.015438318252563477 save_final save missing photos in datou_result : time spend for datou_step_exec : 103.04116463661194 time spend to save output : 0.016027212142944336 total time spend for step 3 : 103.05719184875488 step4:ventilate_hashtags_in_portfolio Tue May 20 20:55:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23180313 get user id for portfolio 23180313 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23180313 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','autre','environnement','papier','background','pet_fonce','flou','carton','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23180313 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','autre','environnement','papier','background','pet_fonce','flou','carton','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23180313 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','autre','environnement','papier','background','pet_fonce','flou','carton','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23181002,23181003,23181004,23181005,23181006,23181007,23181008,23181009,23181010,23181011,23181012?tags=metal,pehd,autre,environnement,papier,background,pet_fonce,flou,carton,pet_clair,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359829271, 1359829269, 1359829267, 1359829264, 1359829260, 1359829250, 1359829244, 1359829237, 1359829231] Looping around the photos to save general results len do output : 1 /23180313. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829271', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829269', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829267', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829264', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829260', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829250', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829244', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829237', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829231', None, None, None, None, None, '2913535') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014713048934936523 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.602118968963623 time spend to save output : 0.015176773071289062 total time spend for step 4 : 1.617295742034912 step5:final Tue May 20 20:55:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359829271: ('0.08694197959533603',), 1359829269: ('0.08694197959533603',), 1359829267: ('0.08694197959533603',), 1359829264: ('0.08694197959533603',), 1359829260: ('0.08694197959533603',), 1359829250: ('0.08694197959533603',), 1359829244: ('0.08694197959533603',), 1359829237: ('0.08694197959533603',), 1359829231: ('0.08694197959533603',)} new output for save of step final : {1359829271: ('0.08694197959533603',), 1359829269: ('0.08694197959533603',), 1359829267: ('0.08694197959533603',), 1359829264: ('0.08694197959533603',), 1359829260: ('0.08694197959533603',), 1359829250: ('0.08694197959533603',), 1359829244: ('0.08694197959533603',), 1359829237: ('0.08694197959533603',), 1359829231: ('0.08694197959533603',)} [1359829271, 1359829269, 1359829267, 1359829264, 1359829260, 1359829250, 1359829244, 1359829237, 1359829231] Looping around the photos to save general results len do output : 9 /1359829271.Didn't retrieve data . /1359829269.Didn't retrieve data . /1359829267.Didn't retrieve data . /1359829264.Didn't retrieve data . /1359829260.Didn't retrieve data . /1359829250.Didn't retrieve data . /1359829244.Didn't retrieve data . /1359829237.Didn't retrieve data . /1359829231.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829271', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829269', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829267', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829264', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829260', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829250', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829244', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829237', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829231', None, None, None, None, None, '2913535') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014242887496948242 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11414408683776855 time spend to save output : 0.014806985855102539 total time spend for step 5 : 0.1289510726928711 step6:blur_detection Tue May 20 20:55:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747767030_3900909_1359829271_2c7e3d5cf833981c9c12797314641628.jpg resize: (2160, 3840) 1359829271 -5.531871858750959 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb.jpg resize: (2160, 3840) 1359829269 -5.814967223621006 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242.jpg resize: (2160, 3840) 1359829267 -5.800922393464949 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42.jpg resize: (2160, 3840) 1359829264 -5.752868308702508 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175.jpg resize: (2160, 3840) 1359829260 -5.733678783891977 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64.jpg resize: (2160, 3840) 1359829250 -5.636512958612684 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9.jpg resize: (2160, 3840) 1359829244 -5.902815729477384 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920.jpg resize: (2160, 3840) 1359829237 -5.67546334062005 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f.jpg resize: (2160, 3840) 1359829231 -5.758611873356318 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557337_0.png resize: (125, 220) 1359856861 -2.0136461664792655 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557340_0.png resize: (186, 104) 1359856862 -3.7267985320899695 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557341_0.png resize: (191, 297) 1359856863 -3.24118746046573 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557342_0.png resize: (253, 283) 1359856864 -3.130559153101554 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557343_0.png resize: (166, 142) 1359856865 -2.035627092475704 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557344_0.png resize: (166, 109) 1359856866 -3.075172801427918 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557345_0.png resize: (224, 95) 1359856867 -2.551266222886249 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557348_0.png resize: (259, 191) 1359856868 -4.588657307594231 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557352_0.png resize: (121, 229) 1359856869 0.4179583726001295 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557353_0.png resize: (210, 170) 1359856870 0.7878377401289585 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557354_0.png resize: (436, 217) 1359856871 -4.082790993102978 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557359_0.png resize: (191, 194) 1359856872 1.225735666239203 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557360_0.png resize: (460, 216) 1359856873 -4.313357630014427 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557361_0.png resize: (387, 285) 1359856874 -4.646770428455855 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557363_0.png resize: (316, 171) 1359856875 0.9807442353011916 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557365_0.png resize: (111, 135) 1359856876 -2.797109661024696 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557368_0.png resize: (205, 137) 1359856877 -2.7389786732350188 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557369_0.png resize: (175, 237) 1359856878 -3.0546964466293516 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557370_0.png resize: (161, 219) 1359856879 -2.6266237630156155 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557375_0.png resize: (275, 285) 1359856880 -4.72511008363938 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557377_0.png resize: (200, 214) 1359856881 -1.6757091717578476 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557378_0.png resize: (210, 204) 1359856882 0.3628496647393459 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557379_0.png resize: (223, 279) 1359856883 -1.7717334015381285 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557380_0.png resize: (105, 136) 1359856884 2.058901713520487 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557381_0.png resize: (418, 390) 1359856885 -1.175584041787023 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557382_0.png resize: (604, 595) 1359856886 -3.138791459458248 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557383_0.png resize: (379, 365) 1359856888 -3.578693447444174 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557384_0.png resize: (292, 221) 1359856889 -3.141422479010111 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557385_0.png resize: (98, 79) 1359856890 -2.901918995806942 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557386_0.png resize: (154, 72) 1359856891 -3.2393730781992125 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557387_0.png resize: (304, 251) 1359856892 -3.537825432429442 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557390_0.png resize: (376, 217) 1359856893 -3.2646187013382924 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557392_0.png resize: (205, 177) 1359856895 -0.24812109882777275 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557393_0.png resize: (319, 404) 1359856896 -3.7621220089349223 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557394_0.png resize: (359, 311) 1359856897 -3.313480134369159 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557395_0.png resize: (249, 291) 1359856898 -2.7066513662892193 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557396_0.png resize: (110, 108) 1359856899 -0.6825363213590057 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557398_0.png resize: (276, 343) 1359856900 0.33800110137498757 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557401_0.png resize: (221, 152) 1359856901 -3.527951491219808 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557403_0.png resize: (236, 350) 1359856902 0.08875731217958822 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557405_0.png resize: (322, 485) 1359856903 -3.455253450188032 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557407_0.png resize: (591, 650) 1359856904 -1.2362684134441333 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557409_0.png resize: (280, 159) 1359856905 -2.5951108133954195 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557411_0.png resize: (197, 153) 1359856906 -2.9224200325828273 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557412_0.png resize: (196, 199) 1359856907 -2.2369309513656113 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557414_0.png resize: (119, 111) 1359856908 -1.8465505981181762 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557417_0.png resize: (302, 118) 1359856909 -2.2934207651495817 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557418_0.png resize: (318, 283) 1359856910 -4.0008821911722325 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557419_0.png resize: (261, 259) 1359856911 0.996324582200985 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557420_0.png resize: (495, 269) 1359856912 -2.0144495591055978 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557421_0.png resize: (145, 68) 1359856913 -2.642350994555636 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557422_0.png resize: (98, 75) 1359856914 -1.933986949171384 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557423_0.png resize: (276, 583) 1359856915 -2.5853360010895017 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557424_0.png resize: (162, 299) 1359856916 2.512183407579302 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557427_0.png resize: (166, 120) 1359856917 -0.03775116013775057 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557429_0.png resize: (98, 288) 1359856918 -3.245377257964354 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557430_0.png resize: (283, 280) 1359856919 -3.1962739575540704 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557432_0.png resize: (118, 114) 1359856920 -2.5443920781919718 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557435_0.png resize: (323, 202) 1359856921 -1.8701323707754414 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557436_0.png resize: (157, 86) 1359856922 -2.980581893900464 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557437_0.png resize: (105, 140) 1359856924 -1.665091154224498 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557438_0.png resize: (198, 228) 1359856925 -3.651131225508115 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557440_0.png resize: (392, 225) 1359856926 -2.640706870309947 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557441_0.png resize: (350, 143) 1359856927 -2.6751006912660595 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557442_0.png resize: (189, 230) 1359856928 -1.2381556500106083 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557446_0.png resize: (202, 139) 1359856929 0.6326517596349136 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557447_0.png resize: (229, 285) 1359856930 -3.0468980416810316 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557448_0.png resize: (254, 123) 1359856931 -2.032220439587234 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557450_0.png resize: (274, 156) 1359856932 -2.126458683286712 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557452_0.png resize: (669, 471) 1359856933 -3.3272127286854354 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557453_0.png resize: (214, 197) 1359856934 -2.3661635475732297 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557455_0.png resize: (666, 211) 1359856935 -4.4038221764934145 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557456_0.png resize: (191, 229) 1359856936 -3.084476915745104 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557349_0.png resize: (451, 275) 1359856939 -3.17549973264524 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557350_0.png resize: (204, 96) 1359856940 -3.4269629112774793 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557367_0.png resize: (169, 101) 1359856941 -2.3454155349141264 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557371_0.png resize: (245, 114) 1359856942 -4.079964054384994 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557372_0.png resize: (261, 121) 1359856943 -2.7761800932769796 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557410_0.png resize: (302, 280) 1359856944 -3.4382342381974373 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557449_0.png resize: (106, 96) 1359856945 -3.0727237778079073 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557338_0.png resize: (301, 372) 1359857012 -4.532618584729073 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557339_0.png resize: (517, 385) 1359857013 -3.8207339095379758 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557346_0.png resize: (624, 287) 1359857014 -4.264103566186011 treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557347_0.png resize: (367, 629) 1359857015 -3.0289819013064525 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557351_0.png resize: (112, 232) 1359857016 -4.026561422895852 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557355_0.png resize: (356, 381) 1359857017 -4.804593709705612 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557356_0.png resize: (437, 482) 1359857018 -4.305156730661875 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557357_0.png resize: (442, 315) 1359857019 -3.965073611285079 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557358_0.png resize: (487, 255) 1359857020 -4.208336743424171 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557364_0.png resize: (159, 154) 1359857021 -1.3789371676831408 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557366_0.png resize: (319, 279) 1359857022 -4.194273490783595 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557373_0.png resize: (228, 194) 1359857023 -3.657563244409319 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557374_0.png resize: (307, 431) 1359857024 -4.154825765462711 treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557376_0.png resize: (370, 300) 1359857025 -3.92464375868483 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557388_0.png resize: (152, 501) 1359857026 -4.426333892882783 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557389_0.png resize: (293, 288) 1359857027 -4.054178177275169 treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557391_0.png resize: (260, 454) 1359857028 -2.1170511438174437 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557397_0.png resize: (177, 286) 1359857029 -4.360994817156922 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557399_0.png resize: (292, 446) 1359857030 -3.2165117406356942 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557400_0.png resize: (225, 346) 1359857031 -3.4868345502501485 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557402_0.png resize: (278, 322) 1359857032 -1.4168687956292636 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557404_0.png resize: (166, 109) 1359857033 -3.228357916768504 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557406_0.png resize: (337, 513) 1359857034 -3.549403017005622 treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557408_0.png resize: (363, 385) 1359857035 -3.2606262448251364 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557413_0.png resize: (236, 347) 1359857036 -2.9141247967950608 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557415_0.png resize: (259, 320) 1359857037 -3.7243070421626228 treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557416_0.png resize: (289, 503) 1359857038 -3.793311189564939 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557425_0.png resize: (388, 397) 1359857039 -3.983445376131866 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557426_0.png resize: (238, 122) 1359857040 -3.683072972657894 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557428_0.png resize: (131, 252) 1359857041 -3.498896706594325 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557431_0.png resize: (221, 171) 1359857042 -2.9168177439383536 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557433_0.png resize: (107, 156) 1359857043 -2.967420499233338 treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557434_0.png resize: (309, 387) 1359857044 -4.373081001195647 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557439_0.png resize: (384, 512) 1359857045 -3.891654041174158 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557443_0.png resize: (226, 181) 1359857046 -2.9357477004465196 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557444_0.png resize: (208, 160) 1359857047 -3.9707878159199153 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557445_0.png resize: (284, 222) 1359857048 -4.059690652499126 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557451_0.png resize: (395, 208) 1359857049 -3.9922309846375943 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557454_0.png resize: (654, 247) 1359857050 -4.677893037122861 treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557457_0.png resize: (520, 256) 1359857051 -2.4467036655691463 treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557362_0.png resize: (244, 273) 1359857055 -4.545902049433388 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 130 time used for this insertion : 0.02062249183654785 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 130 time used for this insertion : 0.038421630859375 save missing photos in datou_result : time spend for datou_step_exec : 40.70069885253906 time spend to save output : 0.06493043899536133 total time spend for step 6 : 40.765629291534424 step7:brightness Tue May 20 20:55:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747767030_3900909_1359829271_2c7e3d5cf833981c9c12797314641628.jpg treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb.jpg treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242.jpg treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42.jpg treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175.jpg treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64.jpg treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9.jpg treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920.jpg treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f.jpg treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557337_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557340_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557341_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557342_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557343_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557344_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557345_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557348_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557352_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557353_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557354_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557359_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557360_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557361_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557363_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557365_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557368_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557369_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557370_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557375_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557377_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557378_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557379_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557380_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557381_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557382_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557383_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557384_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557385_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557386_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557387_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557390_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557392_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557393_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557394_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557395_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557396_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557398_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557401_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557403_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557405_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557407_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557409_0.png treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557411_0.png treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557412_0.png treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557414_0.png treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557417_0.png treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557418_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557419_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557420_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557421_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557422_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557423_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557424_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557427_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557429_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557430_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557432_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557435_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557436_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557437_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557438_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557440_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557441_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557442_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557446_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557447_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557448_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557450_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557452_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557453_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557455_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557456_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557349_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557350_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557367_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557371_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557372_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557410_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557449_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557338_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557339_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557346_0.png treat image : temp/1747767030_3900909_1359829269_25502bb52d3f0693de739667bb6828cb_rle_crop_3806557347_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557351_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557355_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557356_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557357_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557358_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557364_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557366_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557373_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557374_0.png treat image : temp/1747767030_3900909_1359829264_5ecf35d809bb3bbbd2e91399e2bd1b42_rle_crop_3806557376_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557388_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557389_0.png treat image : temp/1747767030_3900909_1359829260_3ef552fe4f368f287789d7e8cad28175_rle_crop_3806557391_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557397_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557399_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557400_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557402_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557404_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557406_0.png treat image : temp/1747767030_3900909_1359829250_df68a6fff38d39b27c4f1a079f331d64_rle_crop_3806557408_0.png treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557413_0.png treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557415_0.png treat image : temp/1747767030_3900909_1359829244_8f554eaf1caf3fce272be9d301eaccd9_rle_crop_3806557416_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557425_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557426_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557428_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557431_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557433_0.png treat image : temp/1747767030_3900909_1359829237_9faf63977d79f4ef1977a9fd4046e920_rle_crop_3806557434_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557439_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557443_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557444_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557445_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557451_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557454_0.png treat image : temp/1747767030_3900909_1359829231_d5a6e12b8e1123b299730edd2597680f_rle_crop_3806557457_0.png treat image : temp/1747767030_3900909_1359829267_5371c94473b05aa3fed0e1529025d242_rle_crop_3806557362_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 130 time used for this insertion : 0.019316673278808594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 130 time used for this insertion : 0.036315202713012695 save missing photos in datou_result : time spend for datou_step_exec : 12.40480637550354 time spend to save output : 0.0607759952545166 total time spend for step 7 : 12.465582370758057 step8:velours_tree Tue May 20 20:55:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2460174560546875 time spend to save output : 4.6253204345703125e-05 total time spend for step 8 : 0.2460637092590332 step9:send_mail_cod Tue May 20 20:55:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23180313_20-05-2025_20_55_56.pdf 23181002 imagette231810021747767356 23181003 imagette231810031747767356 23181004 imagette231810041747767356 23181006 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231810061747767356 23181007 imagette231810071747767357 23181008 change filename to text .imagette231810081747767357 23181009 imagette231810091747767357 23181010 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231810101747767357 23181011 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231810111747767358 23181012 imagette231810121747767359 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23180313 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23181002,23181003,23181004,23181005,23181006,23181007,23181008,23181009,23181010,23181011,23181012?tags=metal,pehd,autre,environnement,papier,background,pet_fonce,flou,carton,pet_clair,mal_croppe args[1359829271] : ((1359829271, -5.531871858750959, 492609224), (1359829271, 0.3343875776354125, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com args[1359829269] : ((1359829269, -5.814967223621006, 492609224), (1359829269, 0.6619187358857251, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com args[1359829267] : ((1359829267, -5.800922393464949, 492609224), (1359829267, 0.6927946160251657, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com args[1359829264] : ((1359829264, -5.752868308702508, 492609224), (1359829264, 0.561908032315492, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com args[1359829260] : ((1359829260, -5.733678783891977, 492609224), (1359829260, 0.6230077965853242, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com args[1359829250] : ((1359829250, -5.636512958612684, 492609224), (1359829250, 0.7968478006801372, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com args[1359829244] : ((1359829244, -5.902815729477384, 492609224), (1359829244, 0.7874856447394778, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com args[1359829237] : ((1359829237, -5.67546334062005, 492609224), (1359829237, 0.7415580544376436, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com args[1359829231] : ((1359829231, -5.758611873356318, 492609224), (1359829231, 0.6718311302637163, 2107752395), '0.08694197959533603') We are sending mail with results at report@fotonower.com refus_total : 0.08694197959533603 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23180313 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23180313_20-05-2025_20_55_56.pdf results_Auto_P23180313_20-05-2025_20_55_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23180313_20-05-2025_20_55_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23180313','results_Auto_P23180313_20-05-2025_20_55_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23180313_20-05-2025_20_55_56.pdf','pdf','','0.6','0.08694197959533603') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23180313

https://www.fotonower.com/image?json=false&list_photos_id=1359829271
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359829269
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359829267
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359829264
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359829260
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359829250
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359829244
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359829237
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359829231
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.69%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23181006?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23181008?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23181010?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23181011?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23180313_20-05-2025_20_55_56.pdf.

Lien vers velours :https://www.fotonower.com/velours/23181002,23181003,23181004,23181005,23181006,23181007,23181008,23181009,23181010,23181011,23181012?tags=metal,pehd,autre,environnement,papier,background,pet_fonce,flou,carton,pet_clair,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 20 May 2025 18:56:02 GMT Content-Length: 0 Connection: close X-Message-Id: -bE9lS9rTvOt7x7H833yfw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359829271, 1359829269, 1359829267, 1359829264, 1359829260, 1359829250, 1359829244, 1359829237, 1359829231] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829271', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829269', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829267', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829264', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829260', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829250', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829244', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829237', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829231', None, None, None, None, None, '2913535') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01331329345703125 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.915550470352173 time spend to save output : 0.013568639755249023 total time spend for step 9 : 6.929119110107422 step10:split_time_score Tue May 20 20:56:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20052025 23180313 Nombre de photos uploadées : 9 / 23040 (0%) 20052025 23180313 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 20052025 23180313 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007278919219970703 elapsed_time : insert_dashboard_record_day_entry 0.02564239501953125 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09201400421027917 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157181_20-05-2025_08_46_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157181 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157181 AND mptpi.`type`=3594 To do Qualite : 0.10180426772060878 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157188_20-05-2025_08_35_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157188 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157188 AND mptpi.`type`=3594 To do Qualite : 0.09871742380401231 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157192_20-05-2025_08_28_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157192 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157192 AND mptpi.`type`=3594 To do Qualite : 0.10408518822159352 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23161557_20-05-2025_10_30_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23161557 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23161557 AND mptpi.`type`=3594 To do Qualite : 0.1308608699845679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23164737_20-05-2025_11_54_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23164737 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23164737 AND mptpi.`type`=3594 To do Qualite : 0.1064864810896508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23164744_20-05-2025_12_03_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23164744 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23164744 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170102 order by id desc limit 1 Qualite : 0.11795572916666669 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170104_20-05-2025_15_34_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170104 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170104 AND mptpi.`type`=3594 To do Qualite : 0.02726871178050528 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23166958_20-05-2025_13_30_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23166958 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23166958 AND mptpi.`type`=3726 To do Qualite : 0.09543954354745371 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23166961_20-05-2025_13_20_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23166961 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23166961 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170110 order by id desc limit 1 Qualite : 0.10659472484016758 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170112_20-05-2025_15_29_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170112 AND mptpi.`type`=3594 To do Qualite : 0.11812746691001888 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23171910_20-05-2025_17_03_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23171910 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23171910 AND mptpi.`type`=3594 To do Qualite : 0.19817297078617974 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172899_20-05-2025_16_57_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172899 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172899 AND mptpi.`type`=3594 To do Qualite : 0.20049805783529734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172907_20-05-2025_16_49_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172907 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23180311 order by id desc limit 1 Qualite : 0.08694197959533603 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23180313_20-05-2025_20_55_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23180313 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23180313 AND mptpi.`type`=3594 To do Qualite : 0.13942144974046014 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23176165_20-05-2025_20_19_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23176165 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23176165 AND mptpi.`type`=3594 To do Qualite : 0.14197543925218625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23176167_20-05-2025_18_56_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23176167 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23176167 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23179278 order by id desc limit 1 Qualite : 0.09473824295343136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23179281_20-05-2025_20_30_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23179281 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23179281 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23179282 order by id desc limit 1 Qualite : 0.07927160493827161 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23179284_20-05-2025_20_16_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23179284 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23179284 AND mptpi.`type`=3594 To do Qualite : 0.12132243269124779 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23180321_20-05-2025_20_49_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23180321 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23180321 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359829271, 1359829269, 1359829267, 1359829264, 1359829260, 1359829250, 1359829244, 1359829237, 1359829231] Looping around the photos to save general results len do output : 1 /23180313Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829271', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829269', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829267', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829264', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829260', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829250', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829244', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829237', None, None, None, None, None, '2913535') ('3318', None, None, None, None, None, None, None, '2913535') ('3318', '23180313', '1359829231', None, None, None, None, None, '2913535') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.015732765197753906 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.837601900100708 time spend to save output : 0.01598834991455078 total time spend for step 10 : 5.853590250015259 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 138.67user 149.73system 5:42.68elapsed 84%CPU (0avgtext+0avgdata 4966536maxresident)k 734536inputs+109808outputs (13927major+13576263minor)pagefaults 0swaps