python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3752496 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2913063'] with mtr_portfolio_ids : ['23179284'] and first list_photo_ids : [] new path : /proc/3752496/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.848034381866455 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 20 20:10:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-20 20:10:33.820760: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-20 20:10:33.855166: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-20 20:10:33.857244: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9d08000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-20 20:10:33.857285: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-20 20:10:33.862187: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-20 20:10:34.116775: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4f95700 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-20 20:10:34.116818: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-20 20:10:34.118882: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 20:10:34.120271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 20:10:34.152418: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 20:10:34.170983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 20:10:34.175089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 20:10:34.206717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 20:10:34.212026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 20:10:34.267289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 20:10:34.269073: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 20:10:34.269484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 20:10:34.270695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 20:10:34.270720: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 20:10:34.270731: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 20:10:34.272746: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-20 20:10:34.637185: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 20:10:34.637317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 20:10:34.637342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 20:10:34.637364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 20:10:34.637385: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 20:10:34.637406: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 20:10:34.637426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 20:10:34.637447: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 20:10:34.639016: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 20:10:34.640474: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 20:10:34.640521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 20:10:34.640538: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 20:10:34.640555: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 20:10:34.640570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 20:10:34.640587: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 20:10:34.640602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 20:10:34.640618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 20:10:34.641877: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 20:10:34.641928: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 20:10:34.641938: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 20:10:34.641946: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 20:10:34.643335: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RC2025-05-20 20:10:49.243001: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 20:10:49.614701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 Detection mask done ! Trying to reset tf kernel 3753058 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9776 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0018992424011230469 nb_pixel_total : 30453 time to create 1 rle with old method : 0.05566906929016113 length of segment : 224 time for calcul the mask position with numpy : 0.0005738735198974609 nb_pixel_total : 16126 time to create 1 rle with old method : 0.02058720588684082 length of segment : 130 time for calcul the mask position with numpy : 1.208728551864624 nb_pixel_total : 694241 time to create 1 rle with new method : 0.055603981018066406 length of segment : 723 time for calcul the mask position with numpy : 0.0005943775177001953 nb_pixel_total : 23867 time to create 1 rle with old method : 0.033347129821777344 length of segment : 150 time for calcul the mask position with numpy : 0.001999378204345703 nb_pixel_total : 71719 time to create 1 rle with old method : 0.0804738998413086 length of segment : 340 time for calcul the mask position with numpy : 0.0004260540008544922 nb_pixel_total : 14611 time to create 1 rle with old method : 0.018102407455444336 length of segment : 139 time for calcul the mask position with numpy : 0.0004494190216064453 nb_pixel_total : 22183 time to create 1 rle with old method : 0.02943253517150879 length of segment : 161 time for calcul the mask position with numpy : 0.0009517669677734375 nb_pixel_total : 43717 time to create 1 rle with old method : 0.05503082275390625 length of segment : 270 time for calcul the mask position with numpy : 0.0008423328399658203 nb_pixel_total : 35508 time to create 1 rle with old method : 0.043493032455444336 length of segment : 154 time for calcul the mask position with numpy : 0.0005764961242675781 nb_pixel_total : 25071 time to create 1 rle with old method : 0.02966594696044922 length of segment : 208 time for calcul the mask position with numpy : 0.002311229705810547 nb_pixel_total : 88018 time to create 1 rle with old method : 0.11142230033874512 length of segment : 313 time for calcul the mask position with numpy : 0.002942800521850586 nb_pixel_total : 120130 time to create 1 rle with old method : 0.15373015403747559 length of segment : 623 time for calcul the mask position with numpy : 0.0018072128295898438 nb_pixel_total : 93634 time to create 1 rle with old method : 0.11005163192749023 length of segment : 500 time for calcul the mask position with numpy : 0.0020558834075927734 nb_pixel_total : 113550 time to create 1 rle with old method : 0.12714672088623047 length of segment : 670 time for calcul the mask position with numpy : 0.0006358623504638672 nb_pixel_total : 26004 time to create 1 rle with old method : 0.046880483627319336 length of segment : 261 time for calcul the mask position with numpy : 0.0005166530609130859 nb_pixel_total : 12688 time to create 1 rle with old method : 0.014936208724975586 length of segment : 156 time for calcul the mask position with numpy : 0.0006718635559082031 nb_pixel_total : 13945 time to create 1 rle with old method : 0.016483306884765625 length of segment : 122 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 6833 time to create 1 rle with old method : 0.00820159912109375 length of segment : 76 time for calcul the mask position with numpy : 0.0004715919494628906 nb_pixel_total : 25296 time to create 1 rle with old method : 0.0290987491607666 length of segment : 185 time for calcul the mask position with numpy : 0.0022401809692382812 nb_pixel_total : 61355 time to create 1 rle with old method : 0.09084343910217285 length of segment : 300 time for calcul the mask position with numpy : 0.0012502670288085938 nb_pixel_total : 24801 time to create 1 rle with old method : 0.02912759780883789 length of segment : 174 time for calcul the mask position with numpy : 0.002218961715698242 nb_pixel_total : 73965 time to create 1 rle with old method : 0.08297848701477051 length of segment : 308 time for calcul the mask position with numpy : 0.0007300376892089844 nb_pixel_total : 18919 time to create 1 rle with old method : 0.021844863891601562 length of segment : 133 time for calcul the mask position with numpy : 0.0011591911315917969 nb_pixel_total : 26253 time to create 1 rle with old method : 0.030284881591796875 length of segment : 205 time for calcul the mask position with numpy : 0.0011935234069824219 nb_pixel_total : 27324 time to create 1 rle with old method : 0.03090190887451172 length of segment : 197 time for calcul the mask position with numpy : 0.0020215511322021484 nb_pixel_total : 60561 time to create 1 rle with old method : 0.06778907775878906 length of segment : 347 time for calcul the mask position with numpy : 0.0013344287872314453 nb_pixel_total : 32257 time to create 1 rle with old method : 0.03938746452331543 length of segment : 186 time for calcul the mask position with numpy : 0.0004951953887939453 nb_pixel_total : 10324 time to create 1 rle with old method : 0.012351751327514648 length of segment : 110 time for calcul the mask position with numpy : 0.005087375640869141 nb_pixel_total : 94695 time to create 1 rle with old method : 0.10795164108276367 length of segment : 470 time for calcul the mask position with numpy : 0.0014717578887939453 nb_pixel_total : 33038 time to create 1 rle with old method : 0.037763357162475586 length of segment : 344 time for calcul the mask position with numpy : 0.0019288063049316406 nb_pixel_total : 49278 time to create 1 rle with old method : 0.05863165855407715 length of segment : 295 time for calcul the mask position with numpy : 0.0007181167602539062 nb_pixel_total : 21413 time to create 1 rle with old method : 0.02541351318359375 length of segment : 192 time for calcul the mask position with numpy : 0.005191802978515625 nb_pixel_total : 119486 time to create 1 rle with old method : 0.1361093521118164 length of segment : 498 time for calcul the mask position with numpy : 0.0005171298980712891 nb_pixel_total : 13007 time to create 1 rle with old method : 0.015254497528076172 length of segment : 103 time for calcul the mask position with numpy : 0.0008518695831298828 nb_pixel_total : 23161 time to create 1 rle with old method : 0.026619911193847656 length of segment : 213 time for calcul the mask position with numpy : 0.0006837844848632812 nb_pixel_total : 17854 time to create 1 rle with old method : 0.020671844482421875 length of segment : 153 time for calcul the mask position with numpy : 0.0012345314025878906 nb_pixel_total : 26373 time to create 1 rle with old method : 0.04387974739074707 length of segment : 194 time for calcul the mask position with numpy : 0.0009622573852539062 nb_pixel_total : 19617 time to create 1 rle with old method : 0.02273845672607422 length of segment : 170 time for calcul the mask position with numpy : 0.0006449222564697266 nb_pixel_total : 10321 time to create 1 rle with old method : 0.01228022575378418 length of segment : 161 time for calcul the mask position with numpy : 0.0009043216705322266 nb_pixel_total : 24976 time to create 1 rle with old method : 0.02899622917175293 length of segment : 191 time for calcul the mask position with numpy : 0.0019974708557128906 nb_pixel_total : 65263 time to create 1 rle with old method : 0.07279658317565918 length of segment : 298 time for calcul the mask position with numpy : 0.0004355907440185547 nb_pixel_total : 15532 time to create 1 rle with old method : 0.018169403076171875 length of segment : 229 time for calcul the mask position with numpy : 0.0003151893615722656 nb_pixel_total : 16195 time to create 1 rle with old method : 0.018898963928222656 length of segment : 161 time for calcul the mask position with numpy : 0.001566171646118164 nb_pixel_total : 18282 time to create 1 rle with old method : 0.021643877029418945 length of segment : 311 time for calcul the mask position with numpy : 0.0018296241760253906 nb_pixel_total : 59501 time to create 1 rle with old method : 0.07101273536682129 length of segment : 447 time for calcul the mask position with numpy : 0.0006837844848632812 nb_pixel_total : 17005 time to create 1 rle with old method : 0.020516395568847656 length of segment : 112 time for calcul the mask position with numpy : 0.0007855892181396484 nb_pixel_total : 16653 time to create 1 rle with old method : 0.02032780647277832 length of segment : 138 time for calcul the mask position with numpy : 0.0009336471557617188 nb_pixel_total : 20311 time to create 1 rle with old method : 0.02443671226501465 length of segment : 211 time for calcul the mask position with numpy : 0.0015044212341308594 nb_pixel_total : 25970 time to create 1 rle with old method : 0.029922962188720703 length of segment : 248 time for calcul the mask position with numpy : 0.0007984638214111328 nb_pixel_total : 13853 time to create 1 rle with old method : 0.018259525299072266 length of segment : 131 time for calcul the mask position with numpy : 0.0022115707397460938 nb_pixel_total : 39504 time to create 1 rle with old method : 0.045426130294799805 length of segment : 341 time for calcul the mask position with numpy : 0.002461671829223633 nb_pixel_total : 49193 time to create 1 rle with old method : 0.056697845458984375 length of segment : 358 time for calcul the mask position with numpy : 0.0006301403045654297 nb_pixel_total : 14176 time to create 1 rle with old method : 0.016259193420410156 length of segment : 152 time for calcul the mask position with numpy : 0.0016608238220214844 nb_pixel_total : 35979 time to create 1 rle with old method : 0.04173398017883301 length of segment : 251 time for calcul the mask position with numpy : 0.0004737377166748047 nb_pixel_total : 8526 time to create 1 rle with old method : 0.010254859924316406 length of segment : 75 time for calcul the mask position with numpy : 0.0007140636444091797 nb_pixel_total : 13196 time to create 1 rle with old method : 0.015974998474121094 length of segment : 105 time for calcul the mask position with numpy : 0.005350828170776367 nb_pixel_total : 140199 time to create 1 rle with old method : 0.17740821838378906 length of segment : 404 time for calcul the mask position with numpy : 0.0007388591766357422 nb_pixel_total : 19073 time to create 1 rle with old method : 0.021810293197631836 length of segment : 180 time for calcul the mask position with numpy : 0.0018494129180908203 nb_pixel_total : 49133 time to create 1 rle with old method : 0.05530190467834473 length of segment : 291 time for calcul the mask position with numpy : 0.002104520797729492 nb_pixel_total : 36964 time to create 1 rle with old method : 0.0424656867980957 length of segment : 250 time for calcul the mask position with numpy : 0.0007314682006835938 nb_pixel_total : 11829 time to create 1 rle with old method : 0.016672849655151367 length of segment : 134 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 6703 time to create 1 rle with old method : 0.00794363021850586 length of segment : 81 time for calcul the mask position with numpy : 0.0013289451599121094 nb_pixel_total : 26969 time to create 1 rle with old method : 0.030661582946777344 length of segment : 282 time for calcul the mask position with numpy : 0.0024194717407226562 nb_pixel_total : 52197 time to create 1 rle with old method : 0.058194637298583984 length of segment : 337 time for calcul the mask position with numpy : 0.00045228004455566406 nb_pixel_total : 8080 time to create 1 rle with old method : 0.009525537490844727 length of segment : 114 time for calcul the mask position with numpy : 0.00571894645690918 nb_pixel_total : 146519 time to create 1 rle with old method : 0.16406011581420898 length of segment : 470 time for calcul the mask position with numpy : 0.0004742145538330078 nb_pixel_total : 7744 time to create 1 rle with old method : 0.009320974349975586 length of segment : 97 time for calcul the mask position with numpy : 0.001443624496459961 nb_pixel_total : 35743 time to create 1 rle with old method : 0.041467905044555664 length of segment : 138 time for calcul the mask position with numpy : 0.001142740249633789 nb_pixel_total : 26404 time to create 1 rle with old method : 0.031147480010986328 length of segment : 135 time for calcul the mask position with numpy : 0.0014257431030273438 nb_pixel_total : 25065 time to create 1 rle with old method : 0.029323101043701172 length of segment : 210 time for calcul the mask position with numpy : 0.002679109573364258 nb_pixel_total : 53577 time to create 1 rle with old method : 0.05967998504638672 length of segment : 308 time for calcul the mask position with numpy : 0.0015327930450439453 nb_pixel_total : 46253 time to create 1 rle with old method : 0.05257749557495117 length of segment : 201 time for calcul the mask position with numpy : 0.0010552406311035156 nb_pixel_total : 16957 time to create 1 rle with old method : 0.021114826202392578 length of segment : 200 time for calcul the mask position with numpy : 0.0037741661071777344 nb_pixel_total : 58516 time to create 1 rle with old method : 0.0821232795715332 length of segment : 668 time for calcul the mask position with numpy : 0.0015630722045898438 nb_pixel_total : 36886 time to create 1 rle with old method : 0.04168272018432617 length of segment : 206 time for calcul the mask position with numpy : 0.0013201236724853516 nb_pixel_total : 23586 time to create 1 rle with old method : 0.028452396392822266 length of segment : 213 time for calcul the mask position with numpy : 0.0017974376678466797 nb_pixel_total : 36946 time to create 1 rle with old method : 0.04269599914550781 length of segment : 191 time for calcul the mask position with numpy : 0.0007500648498535156 nb_pixel_total : 15614 time to create 1 rle with old method : 0.018016815185546875 length of segment : 165 time for calcul the mask position with numpy : 0.011409521102905273 nb_pixel_total : 326273 time to create 1 rle with new method : 0.0352170467376709 length of segment : 818 time for calcul the mask position with numpy : 0.00046515464782714844 nb_pixel_total : 10634 time to create 1 rle with old method : 0.017012357711791992 length of segment : 119 time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 11823 time to create 1 rle with old method : 0.020182132720947266 length of segment : 98 time for calcul the mask position with numpy : 0.0033130645751953125 nb_pixel_total : 82175 time to create 1 rle with old method : 0.09499549865722656 length of segment : 487 time for calcul the mask position with numpy : 0.0019860267639160156 nb_pixel_total : 38810 time to create 1 rle with old method : 0.044595956802368164 length of segment : 302 time for calcul the mask position with numpy : 0.002008676528930664 nb_pixel_total : 53475 time to create 1 rle with old method : 0.06177163124084473 length of segment : 255 time for calcul the mask position with numpy : 0.0020084381103515625 nb_pixel_total : 51200 time to create 1 rle with old method : 0.058428287506103516 length of segment : 370 time for calcul the mask position with numpy : 0.0010936260223388672 nb_pixel_total : 25371 time to create 1 rle with old method : 0.02922201156616211 length of segment : 248 time for calcul the mask position with numpy : 0.0011143684387207031 nb_pixel_total : 25734 time to create 1 rle with old method : 0.029289722442626953 length of segment : 266 time for calcul the mask position with numpy : 0.011067390441894531 nb_pixel_total : 369454 time to create 1 rle with new method : 0.12937641143798828 length of segment : 591 time for calcul the mask position with numpy : 0.0028028488159179688 nb_pixel_total : 75118 time to create 1 rle with old method : 0.08448529243469238 length of segment : 405 time for calcul the mask position with numpy : 0.0003581047058105469 nb_pixel_total : 8196 time to create 1 rle with old method : 0.00957798957824707 length of segment : 140 time for calcul the mask position with numpy : 0.0005946159362792969 nb_pixel_total : 13759 time to create 1 rle with old method : 0.01622939109802246 length of segment : 148 time for calcul the mask position with numpy : 0.0018062591552734375 nb_pixel_total : 73080 time to create 1 rle with old method : 0.08543848991394043 length of segment : 396 time for calcul the mask position with numpy : 0.004572153091430664 nb_pixel_total : 142094 time to create 1 rle with old method : 0.16007328033447266 length of segment : 491 time for calcul the mask position with numpy : 0.001528024673461914 nb_pixel_total : 33090 time to create 1 rle with old method : 0.03801751136779785 length of segment : 259 time for calcul the mask position with numpy : 0.0009632110595703125 nb_pixel_total : 15897 time to create 1 rle with old method : 0.018650054931640625 length of segment : 212 time for calcul the mask position with numpy : 0.0010607242584228516 nb_pixel_total : 31455 time to create 1 rle with old method : 0.0357813835144043 length of segment : 243 time for calcul the mask position with numpy : 0.0015838146209716797 nb_pixel_total : 42298 time to create 1 rle with old method : 0.04849982261657715 length of segment : 217 time for calcul the mask position with numpy : 0.0040743350982666016 nb_pixel_total : 126467 time to create 1 rle with old method : 0.14236140251159668 length of segment : 624 time for calcul the mask position with numpy : 0.005880594253540039 nb_pixel_total : 246829 time to create 1 rle with new method : 0.015900611877441406 length of segment : 628 time for calcul the mask position with numpy : 0.0010509490966796875 nb_pixel_total : 24648 time to create 1 rle with old method : 0.02899003028869629 length of segment : 256 time for calcul the mask position with numpy : 0.0027403831481933594 nb_pixel_total : 113195 time to create 1 rle with old method : 0.12703943252563477 length of segment : 359 time for calcul the mask position with numpy : 0.0006997585296630859 nb_pixel_total : 13530 time to create 1 rle with old method : 0.015391349792480469 length of segment : 236 time for calcul the mask position with numpy : 0.0007948875427246094 nb_pixel_total : 20305 time to create 1 rle with old method : 0.02345752716064453 length of segment : 225 time for calcul the mask position with numpy : 0.0007898807525634766 nb_pixel_total : 26985 time to create 1 rle with old method : 0.03096771240234375 length of segment : 174 time for calcul the mask position with numpy : 0.0011470317840576172 nb_pixel_total : 52231 time to create 1 rle with old method : 0.05884575843811035 length of segment : 303 time for calcul the mask position with numpy : 0.0018305778503417969 nb_pixel_total : 76236 time to create 1 rle with old method : 0.08483481407165527 length of segment : 380 time for calcul the mask position with numpy : 0.0014865398406982422 nb_pixel_total : 54145 time to create 1 rle with old method : 0.06306219100952148 length of segment : 245 time for calcul the mask position with numpy : 0.0016827583312988281 nb_pixel_total : 78688 time to create 1 rle with old method : 0.08745193481445312 length of segment : 488 time for calcul the mask position with numpy : 0.0011730194091796875 nb_pixel_total : 17377 time to create 1 rle with old method : 0.020986557006835938 length of segment : 253 time for calcul the mask position with numpy : 0.0026903152465820312 nb_pixel_total : 58519 time to create 1 rle with old method : 0.06704211235046387 length of segment : 274 time for calcul the mask position with numpy : 0.0010914802551269531 nb_pixel_total : 14162 time to create 1 rle with old method : 0.02063727378845215 length of segment : 159 time for calcul the mask position with numpy : 0.0013275146484375 nb_pixel_total : 24086 time to create 1 rle with old method : 0.028214693069458008 length of segment : 183 time for calcul the mask position with numpy : 0.0005433559417724609 nb_pixel_total : 11480 time to create 1 rle with old method : 0.013602256774902344 length of segment : 126 time for calcul the mask position with numpy : 0.0019953250885009766 nb_pixel_total : 39320 time to create 1 rle with old method : 0.04597187042236328 length of segment : 198 time for calcul the mask position with numpy : 0.0009551048278808594 nb_pixel_total : 11596 time to create 1 rle with old method : 0.014001607894897461 length of segment : 168 time for calcul the mask position with numpy : 0.0027370452880859375 nb_pixel_total : 70730 time to create 1 rle with old method : 0.08153152465820312 length of segment : 280 time for calcul the mask position with numpy : 0.0076084136962890625 nb_pixel_total : 204805 time to create 1 rle with new method : 0.01060342788696289 length of segment : 306 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 5918 time to create 1 rle with old method : 0.01027822494506836 length of segment : 59 time for calcul the mask position with numpy : 0.0007550716400146484 nb_pixel_total : 10997 time to create 1 rle with old method : 0.013131856918334961 length of segment : 116 time for calcul the mask position with numpy : 0.0020554065704345703 nb_pixel_total : 30999 time to create 1 rle with old method : 0.03714179992675781 length of segment : 372 time for calcul the mask position with numpy : 0.001979351043701172 nb_pixel_total : 33421 time to create 1 rle with old method : 0.04393482208251953 length of segment : 321 time for calcul the mask position with numpy : 0.00045561790466308594 nb_pixel_total : 9997 time to create 1 rle with old method : 0.016772031784057617 length of segment : 127 time for calcul the mask position with numpy : 0.0005011558532714844 nb_pixel_total : 5303 time to create 1 rle with old method : 0.009258747100830078 length of segment : 72 time for calcul the mask position with numpy : 0.0022041797637939453 nb_pixel_total : 43498 time to create 1 rle with old method : 0.05111193656921387 length of segment : 339 time for calcul the mask position with numpy : 0.0008969306945800781 nb_pixel_total : 13007 time to create 1 rle with old method : 0.015191078186035156 length of segment : 126 time for calcul the mask position with numpy : 0.0005269050598144531 nb_pixel_total : 9547 time to create 1 rle with old method : 0.013322114944458008 length of segment : 213 time for calcul the mask position with numpy : 0.00037670135498046875 nb_pixel_total : 9260 time to create 1 rle with old method : 0.010812044143676758 length of segment : 109 time for calcul the mask position with numpy : 0.008367776870727539 nb_pixel_total : 121854 time to create 1 rle with old method : 0.14165210723876953 length of segment : 474 time for calcul the mask position with numpy : 0.0014638900756835938 nb_pixel_total : 36867 time to create 1 rle with old method : 0.04094195365905762 length of segment : 214 time spent for convertir_results : 14.239210605621338 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 129 chid ids of type : 3594 Number RLEs to save : 33664 save missing photos in datou_result : time spend for datou_step_exec : 103.10025525093079 time spend to save output : 2.375258445739746 total time spend for step 1 : 105.47551369667053 step2:crop_condition Tue May 20 20:12:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 129 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next owe have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747764798_3752496 we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.420448303222656 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747764808_3752496 we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.0628035068511963 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747764812_3752496 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6827127933502197 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359847040, 1359847037, 1359847034, 1359847005, 1359846977, 1359846974, 1359846971, 1359846968, 1359846965, 1359846859] Looping around the photos to save general results len do output : 129 /1359852027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359852450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847040', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847037', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847034', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847005', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846977', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846974', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846971', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846968', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846965', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846859', None, None, None, None, None, '2913063') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 397 time used for this insertion : 0.02968621253967285 save_final save missing photos in datou_result : time spend for datou_step_exec : 77.47373962402344 time spend to save output : 0.03312993049621582 total time spend for step 2 : 77.50686955451965 step3:rle_unique_nms_with_priority Tue May 20 20:13:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 129 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 6 time to prepare the origin masks : 8.501368999481201 time for calcul the mask position with numpy : 0.5170753002166748 nb_pixel_total : 7124013 time to create 1 rle with new method : 0.7772750854492188 time for calcul the mask position with numpy : 0.029566287994384766 nb_pixel_total : 120130 time to create 1 rle with old method : 0.13479113578796387 time for calcul the mask position with numpy : 0.026083946228027344 nb_pixel_total : 88018 time to create 1 rle with old method : 0.0966343879699707 time for calcul the mask position with numpy : 0.029848098754882812 nb_pixel_total : 18157 time to create 1 rle with old method : 0.023868083953857422 time for calcul the mask position with numpy : 0.0287778377532959 nb_pixel_total : 35508 time to create 1 rle with old method : 0.040067434310913086 time for calcul the mask position with numpy : 0.028262853622436523 nb_pixel_total : 43717 time to create 1 rle with old method : 0.04875373840332031 time for calcul the mask position with numpy : 0.026294708251953125 nb_pixel_total : 22183 time to create 1 rle with old method : 0.024633407592773438 time for calcul the mask position with numpy : 0.027834415435791016 nb_pixel_total : 14611 time to create 1 rle with old method : 0.0161895751953125 time for calcul the mask position with numpy : 0.033600568771362305 nb_pixel_total : 71719 time to create 1 rle with old method : 0.07960700988769531 time for calcul the mask position with numpy : 0.029108047485351562 nb_pixel_total : 23867 time to create 1 rle with old method : 0.02685093879699707 time for calcul the mask position with numpy : 0.0366826057434082 nb_pixel_total : 685898 time to create 1 rle with new method : 0.9062163829803467 time for calcul the mask position with numpy : 0.027092695236206055 nb_pixel_total : 16126 time to create 1 rle with old method : 0.01786184310913086 time for calcul the mask position with numpy : 0.028472423553466797 nb_pixel_total : 30453 time to create 1 rle with old method : 0.03428363800048828 create new chi : 3.1633241176605225 time to delete rle : 0.020532608032226562 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8838 TO DO : save crop sub photo not yet done ! save time : 0.5472691059112549 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 5.420668601989746 time for calcul the mask position with numpy : 0.6477556228637695 nb_pixel_total : 7941095 time to create 1 rle with new method : 1.2764298915863037 time for calcul the mask position with numpy : 0.042125701904296875 nb_pixel_total : 61355 time to create 1 rle with old method : 0.06945013999938965 time for calcul the mask position with numpy : 0.04634857177734375 nb_pixel_total : 25296 time to create 1 rle with old method : 0.033930063247680664 time for calcul the mask position with numpy : 0.04640316963195801 nb_pixel_total : 6833 time to create 1 rle with old method : 0.009605884552001953 time for calcul the mask position with numpy : 0.03835439682006836 nb_pixel_total : 13945 time to create 1 rle with old method : 0.01516580581665039 time for calcul the mask position with numpy : 0.03170466423034668 nb_pixel_total : 12688 time to create 1 rle with old method : 0.014108419418334961 time for calcul the mask position with numpy : 0.02870917320251465 nb_pixel_total : 26004 time to create 1 rle with old method : 0.0291292667388916 time for calcul the mask position with numpy : 0.02893209457397461 nb_pixel_total : 113550 time to create 1 rle with old method : 0.14329934120178223 time for calcul the mask position with numpy : 0.0293729305267334 nb_pixel_total : 93634 time to create 1 rle with old method : 0.11434793472290039 create new chi : 2.6972389221191406 time to delete rle : 0.0012159347534179688 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6696 TO DO : save crop sub photo not yet done ! save time : 0.5072212219238281 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 7.868365526199341 time for calcul the mask position with numpy : 0.7273905277252197 nb_pixel_total : 7823574 time to create 1 rle with new method : 1.277862787246704 time for calcul the mask position with numpy : 0.027291297912597656 nb_pixel_total : 21413 time to create 1 rle with old method : 0.025650501251220703 time for calcul the mask position with numpy : 0.028882980346679688 nb_pixel_total : 49278 time to create 1 rle with old method : 0.05503726005554199 time for calcul the mask position with numpy : 0.026392698287963867 nb_pixel_total : 33038 time to create 1 rle with old method : 0.03668832778930664 time for calcul the mask position with numpy : 0.026998281478881836 nb_pixel_total : 92693 time to create 1 rle with old method : 0.1060023307800293 time for calcul the mask position with numpy : 0.025127410888671875 nb_pixel_total : 10324 time to create 1 rle with old method : 0.011541366577148438 time for calcul the mask position with numpy : 0.027035236358642578 nb_pixel_total : 32257 time to create 1 rle with old method : 0.035902976989746094 time for calcul the mask position with numpy : 0.029973983764648438 nb_pixel_total : 60561 time to create 1 rle with old method : 0.06751823425292969 time for calcul the mask position with numpy : 0.03021860122680664 nb_pixel_total : 27324 time to create 1 rle with old method : 0.0304563045501709 time for calcul the mask position with numpy : 0.028967618942260742 nb_pixel_total : 26253 time to create 1 rle with old method : 0.03524518013000488 time for calcul the mask position with numpy : 0.025885820388793945 nb_pixel_total : 18919 time to create 1 rle with old method : 0.02114105224609375 time for calcul the mask position with numpy : 0.02872157096862793 nb_pixel_total : 73965 time to create 1 rle with old method : 0.08307480812072754 time for calcul the mask position with numpy : 0.027298688888549805 nb_pixel_total : 24801 time to create 1 rle with old method : 0.16516566276550293 create new chi : 3.0655150413513184 time to delete rle : 0.0016217231750488281 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8026 TO DO : save crop sub photo not yet done ! save time : 0.5218586921691895 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 8.146439790725708 time for calcul the mask position with numpy : 0.7503235340118408 nb_pixel_total : 7850032 time to create 1 rle with new method : 0.7119808197021484 time for calcul the mask position with numpy : 0.03772568702697754 nb_pixel_total : 17005 time to create 1 rle with old method : 0.018958091735839844 time for calcul the mask position with numpy : 0.04320979118347168 nb_pixel_total : 59501 time to create 1 rle with old method : 0.0807182788848877 time for calcul the mask position with numpy : 0.028757572174072266 nb_pixel_total : 18279 time to create 1 rle with old method : 0.02019643783569336 time for calcul the mask position with numpy : 0.02824687957763672 nb_pixel_total : 16049 time to create 1 rle with old method : 0.01812005043029785 time for calcul the mask position with numpy : 0.028316020965576172 nb_pixel_total : 13476 time to create 1 rle with old method : 0.014820337295532227 time for calcul the mask position with numpy : 0.025792598724365234 nb_pixel_total : 65263 time to create 1 rle with old method : 0.07257318496704102 time for calcul the mask position with numpy : 0.03062272071838379 nb_pixel_total : 24976 time to create 1 rle with old method : 0.027792930603027344 time for calcul the mask position with numpy : 0.025902509689331055 nb_pixel_total : 10321 time to create 1 rle with old method : 0.011326789855957031 time for calcul the mask position with numpy : 0.027709245681762695 nb_pixel_total : 19617 time to create 1 rle with old method : 0.02213740348815918 time for calcul the mask position with numpy : 0.030304670333862305 nb_pixel_total : 26373 time to create 1 rle with old method : 0.03355264663696289 time for calcul the mask position with numpy : 0.034853219985961914 nb_pixel_total : 17854 time to create 1 rle with old method : 0.024970531463623047 time for calcul the mask position with numpy : 0.027156829833984375 nb_pixel_total : 23161 time to create 1 rle with old method : 0.025618553161621094 time for calcul the mask position with numpy : 0.028084516525268555 nb_pixel_total : 13007 time to create 1 rle with old method : 0.014702320098876953 time for calcul the mask position with numpy : 0.0295565128326416 nb_pixel_total : 119486 time to create 1 rle with old method : 0.13240265846252441 create new chi : 2.4547924995422363 time to delete rle : 0.0013470649719238281 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 8415 TO DO : save crop sub photo not yet done ! save time : 0.5156805515289307 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 7.316106557846069 time for calcul the mask position with numpy : 0.8801679611206055 nb_pixel_total : 7848634 time to create 1 rle with new method : 0.9094610214233398 time for calcul the mask position with numpy : 0.027461767196655273 nb_pixel_total : 49133 time to create 1 rle with old method : 0.056963443756103516 time for calcul the mask position with numpy : 0.02988910675048828 nb_pixel_total : 19073 time to create 1 rle with old method : 0.030524253845214844 time for calcul the mask position with numpy : 0.03115057945251465 nb_pixel_total : 140199 time to create 1 rle with old method : 0.25193142890930176 time for calcul the mask position with numpy : 0.03353691101074219 nb_pixel_total : 13196 time to create 1 rle with old method : 0.017145395278930664 time for calcul the mask position with numpy : 0.03556060791015625 nb_pixel_total : 8526 time to create 1 rle with old method : 0.009701967239379883 time for calcul the mask position with numpy : 0.030762910842895508 nb_pixel_total : 35979 time to create 1 rle with old method : 0.04016613960266113 time for calcul the mask position with numpy : 0.031416893005371094 nb_pixel_total : 14176 time to create 1 rle with old method : 0.01743459701538086 time for calcul the mask position with numpy : 0.032839298248291016 nb_pixel_total : 49193 time to create 1 rle with old method : 0.05643630027770996 time for calcul the mask position with numpy : 0.029822826385498047 nb_pixel_total : 39504 time to create 1 rle with old method : 0.0491480827331543 time for calcul the mask position with numpy : 0.04208493232727051 nb_pixel_total : 13853 time to create 1 rle with old method : 0.015490293502807617 time for calcul the mask position with numpy : 0.03197741508483887 nb_pixel_total : 25970 time to create 1 rle with old method : 0.02944040298461914 time for calcul the mask position with numpy : 0.02928900718688965 nb_pixel_total : 20311 time to create 1 rle with old method : 0.02452230453491211 time for calcul the mask position with numpy : 0.03126096725463867 nb_pixel_total : 16653 time to create 1 rle with old method : 0.030914306640625 create new chi : 2.8988449573516846 time to delete rle : 0.0022745132446289062 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7930 TO DO : save crop sub photo not yet done ! save time : 0.5145103931427002 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 10.846489191055298 time for calcul the mask position with numpy : 0.8940331935882568 nb_pixel_total : 7621848 time to create 1 rle with new method : 1.0494763851165771 time for calcul the mask position with numpy : 0.04055166244506836 nb_pixel_total : 15614 time to create 1 rle with old method : 0.016587018966674805 time for calcul the mask position with numpy : 0.041654109954833984 nb_pixel_total : 36946 time to create 1 rle with old method : 0.03975558280944824 time for calcul the mask position with numpy : 0.04068422317504883 nb_pixel_total : 23586 time to create 1 rle with old method : 0.02567291259765625 time for calcul the mask position with numpy : 0.040191650390625 nb_pixel_total : 36886 time to create 1 rle with old method : 0.039894819259643555 time for calcul the mask position with numpy : 0.04063701629638672 nb_pixel_total : 58516 time to create 1 rle with old method : 0.06426835060119629 time for calcul the mask position with numpy : 0.03995013236999512 nb_pixel_total : 16957 time to create 1 rle with old method : 0.017984390258789062 time for calcul the mask position with numpy : 0.046457767486572266 nb_pixel_total : 46253 time to create 1 rle with old method : 0.04965543746948242 time for calcul the mask position with numpy : 0.04152703285217285 nb_pixel_total : 53577 time to create 1 rle with old method : 0.058770179748535156 time for calcul the mask position with numpy : 0.038646697998046875 nb_pixel_total : 25065 time to create 1 rle with old method : 0.027974843978881836 time for calcul the mask position with numpy : 0.028142929077148438 nb_pixel_total : 26404 time to create 1 rle with old method : 0.02992534637451172 time for calcul the mask position with numpy : 0.027065277099609375 nb_pixel_total : 35743 time to create 1 rle with old method : 0.03904581069946289 time for calcul the mask position with numpy : 0.025665760040283203 nb_pixel_total : 7744 time to create 1 rle with old method : 0.008575677871704102 time for calcul the mask position with numpy : 0.026387929916381836 nb_pixel_total : 146519 time to create 1 rle with old method : 0.17368602752685547 time for calcul the mask position with numpy : 0.02934432029724121 nb_pixel_total : 8080 time to create 1 rle with old method : 0.009747505187988281 time for calcul the mask position with numpy : 0.04571962356567383 nb_pixel_total : 52197 time to create 1 rle with old method : 0.06831765174865723 time for calcul the mask position with numpy : 0.06464648246765137 nb_pixel_total : 26969 time to create 1 rle with old method : 0.04360842704772949 time for calcul the mask position with numpy : 0.0558934211730957 nb_pixel_total : 6703 time to create 1 rle with old method : 0.010951519012451172 time for calcul the mask position with numpy : 0.06609964370727539 nb_pixel_total : 11829 time to create 1 rle with old method : 0.022961139678955078 time for calcul the mask position with numpy : 0.058151960372924805 nb_pixel_total : 36964 time to create 1 rle with old method : 0.07930541038513184 create new chi : 3.614102840423584 time to delete rle : 0.004039764404296875 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10960 TO DO : save crop sub photo not yet done ! save time : 0.6863181591033936 nb_obj : 10 nb_hashtags : 5 time to prepare the origin masks : 7.200596809387207 time for calcul the mask position with numpy : 0.9513299465179443 nb_pixel_total : 7299451 time to create 1 rle with new method : 1.2579975128173828 time for calcul the mask position with numpy : 0.029166221618652344 nb_pixel_total : 369454 time to create 1 rle with new method : 0.8257448673248291 time for calcul the mask position with numpy : 0.027793407440185547 nb_pixel_total : 25734 time to create 1 rle with old method : 0.027719736099243164 time for calcul the mask position with numpy : 0.02517843246459961 nb_pixel_total : 25371 time to create 1 rle with old method : 0.0319521427154541 time for calcul the mask position with numpy : 0.024979114532470703 nb_pixel_total : 51200 time to create 1 rle with old method : 0.05588555335998535 time for calcul the mask position with numpy : 0.025355815887451172 nb_pixel_total : 53475 time to create 1 rle with old method : 0.0583806037902832 time for calcul the mask position with numpy : 0.024913311004638672 nb_pixel_total : 38810 time to create 1 rle with old method : 0.04151415824890137 time for calcul the mask position with numpy : 0.03150177001953125 nb_pixel_total : 82175 time to create 1 rle with old method : 0.08966779708862305 time for calcul the mask position with numpy : 0.028248071670532227 nb_pixel_total : 11823 time to create 1 rle with old method : 0.013123035430908203 time for calcul the mask position with numpy : 0.027141571044921875 nb_pixel_total : 10634 time to create 1 rle with old method : 0.011840343475341797 time for calcul the mask position with numpy : 0.04507946968078613 nb_pixel_total : 326273 time to create 1 rle with new method : 1.3348772525787354 create new chi : 5.093085527420044 time to delete rle : 0.0014836788177490234 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 9268 TO DO : save crop sub photo not yet done ! save time : 0.5812778472900391 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 6.271019697189331 time for calcul the mask position with numpy : 0.8157098293304443 nb_pixel_total : 7749808 time to create 1 rle with new method : 1.3724079132080078 time for calcul the mask position with numpy : 0.026529550552368164 nb_pixel_total : 126467 time to create 1 rle with old method : 0.1547379493713379 time for calcul the mask position with numpy : 0.0283510684967041 nb_pixel_total : 42298 time to create 1 rle with old method : 0.046488285064697266 time for calcul the mask position with numpy : 0.03195381164550781 nb_pixel_total : 31455 time to create 1 rle with old method : 0.03560972213745117 time for calcul the mask position with numpy : 0.026697158813476562 nb_pixel_total : 15897 time to create 1 rle with old method : 0.01774287223815918 time for calcul the mask position with numpy : 0.028063058853149414 nb_pixel_total : 33090 time to create 1 rle with old method : 0.03756523132324219 time for calcul the mask position with numpy : 0.029323339462280273 nb_pixel_total : 142094 time to create 1 rle with old method : 0.15963435173034668 time for calcul the mask position with numpy : 0.027704715728759766 nb_pixel_total : 56218 time to create 1 rle with old method : 0.06384110450744629 time for calcul the mask position with numpy : 0.026500225067138672 nb_pixel_total : 13759 time to create 1 rle with old method : 0.015319347381591797 time for calcul the mask position with numpy : 0.031064271926879883 nb_pixel_total : 8196 time to create 1 rle with old method : 0.009109735488891602 time for calcul the mask position with numpy : 0.027820587158203125 nb_pixel_total : 75118 time to create 1 rle with old method : 0.08656573295593262 create new chi : 3.1566708087921143 time to delete rle : 0.0017383098602294922 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8213 TO DO : save crop sub photo not yet done ! save time : 0.5437347888946533 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 7.090795516967773 time for calcul the mask position with numpy : 0.5408496856689453 nb_pixel_total : 7587608 time to create 1 rle with new method : 0.8424932956695557 time for calcul the mask position with numpy : 0.026160240173339844 nb_pixel_total : 78688 time to create 1 rle with old method : 0.08684945106506348 time for calcul the mask position with numpy : 0.027074813842773438 nb_pixel_total : 54145 time to create 1 rle with old method : 0.06100296974182129 time for calcul the mask position with numpy : 0.028714418411254883 nb_pixel_total : 76236 time to create 1 rle with old method : 0.09564757347106934 time for calcul the mask position with numpy : 0.032880306243896484 nb_pixel_total : 52231 time to create 1 rle with old method : 0.06847047805786133 time for calcul the mask position with numpy : 0.03030228614807129 nb_pixel_total : 26985 time to create 1 rle with old method : 0.033737897872924805 time for calcul the mask position with numpy : 0.03485274314880371 nb_pixel_total : 20305 time to create 1 rle with old method : 0.02313542366027832 time for calcul the mask position with numpy : 0.025634765625 nb_pixel_total : 13530 time to create 1 rle with old method : 0.015132665634155273 time for calcul the mask position with numpy : 0.0285947322845459 nb_pixel_total : 113195 time to create 1 rle with old method : 0.12508583068847656 time for calcul the mask position with numpy : 0.027111291885375977 nb_pixel_total : 24648 time to create 1 rle with old method : 0.026657581329345703 time for calcul the mask position with numpy : 0.027918577194213867 nb_pixel_total : 246829 time to create 1 rle with new method : 1.314955234527588 create new chi : 3.599752426147461 time to delete rle : 0.0019648075103759766 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 8748 TO DO : save crop sub photo not yet done ! save time : 0.5535011291503906 nb_obj : 21 nb_hashtags : 5 time to prepare the origin masks : 12.068227767944336 time for calcul the mask position with numpy : 0.7346551418304443 nb_pixel_total : 7522833 time to create 1 rle with new method : 0.6621694564819336 time for calcul the mask position with numpy : 0.02785968780517578 nb_pixel_total : 36867 time to create 1 rle with old method : 0.04144287109375 time for calcul the mask position with numpy : 0.04550528526306152 nb_pixel_total : 121854 time to create 1 rle with old method : 0.13458871841430664 time for calcul the mask position with numpy : 0.043830156326293945 nb_pixel_total : 21 time to create 1 rle with old method : 6.699562072753906e-05 time for calcul the mask position with numpy : 0.04384732246398926 nb_pixel_total : 7610 time to create 1 rle with old method : 0.00880122184753418 time for calcul the mask position with numpy : 0.043112754821777344 nb_pixel_total : 13007 time to create 1 rle with old method : 0.015955448150634766 time for calcul the mask position with numpy : 0.038071393966674805 nb_pixel_total : 43498 time to create 1 rle with old method : 0.04769611358642578 time for calcul the mask position with numpy : 0.02670454978942871 nb_pixel_total : 5303 time to create 1 rle with old method : 0.005942821502685547 time for calcul the mask position with numpy : 0.028487205505371094 nb_pixel_total : 9997 time to create 1 rle with old method : 0.011739253997802734 time for calcul the mask position with numpy : 0.02962970733642578 nb_pixel_total : 33421 time to create 1 rle with old method : 0.03721189498901367 time for calcul the mask position with numpy : 0.02922201156616211 nb_pixel_total : 30999 time to create 1 rle with old method : 0.04987478256225586 time for calcul the mask position with numpy : 0.027247905731201172 nb_pixel_total : 10997 time to create 1 rle with old method : 0.024105310440063477 time for calcul the mask position with numpy : 0.026155471801757812 nb_pixel_total : 5918 time to create 1 rle with old method : 0.006592273712158203 time for calcul the mask position with numpy : 0.02722764015197754 nb_pixel_total : 204805 time to create 1 rle with new method : 1.0373432636260986 time for calcul the mask position with numpy : 0.026387929916381836 nb_pixel_total : 70730 time to create 1 rle with old method : 0.0787496566772461 time for calcul the mask position with numpy : 0.02732682228088379 nb_pixel_total : 11596 time to create 1 rle with old method : 0.014768838882446289 time for calcul the mask position with numpy : 0.028932809829711914 nb_pixel_total : 39320 time to create 1 rle with old method : 0.04397869110107422 time for calcul the mask position with numpy : 0.027310609817504883 nb_pixel_total : 11480 time to create 1 rle with old method : 0.012823343276977539 time for calcul the mask position with numpy : 0.026374101638793945 nb_pixel_total : 24086 time to create 1 rle with old method : 0.02697300910949707 time for calcul the mask position with numpy : 0.02831435203552246 nb_pixel_total : 14162 time to create 1 rle with old method : 0.02748584747314453 time for calcul the mask position with numpy : 0.027948617935180664 nb_pixel_total : 58519 time to create 1 rle with old method : 0.07402825355529785 time for calcul the mask position with numpy : 0.026489734649658203 nb_pixel_total : 17377 time to create 1 rle with old method : 0.01958012580871582 create new chi : 3.8606417179107666 time to delete rle : 0.0020999908447265625 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 10865 TO DO : save crop sub photo not yet done ! save time : 0.6548712253570557 map_output_result : {1359847040: (0.0, 'Should be the crop_list due to order', 0), 1359847037: (0.0, 'Should be the crop_list due to order', 0), 1359847034: (0.0, 'Should be the crop_list due to order', 0), 1359847005: (0.0, 'Should be the crop_list due to order', 0), 1359846977: (0.0, 'Should be the crop_list due to order', 0), 1359846974: (0.0, 'Should be the crop_list due to order', 0), 1359846971: (0.0, 'Should be the crop_list due to order', 0), 1359846968: (0.0, 'Should be the crop_list due to order', 0), 1359846965: (0.0, 'Should be the crop_list due to order', 0), 1359846859: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359847040, 1359847037, 1359847034, 1359847005, 1359846977, 1359846974, 1359846971, 1359846968, 1359846965, 1359846859] Looping around the photos to save general results len do output : 10 /1359847040.Didn't retrieve data . /1359847037.Didn't retrieve data . /1359847034.Didn't retrieve data . /1359847005.Didn't retrieve data . /1359846977.Didn't retrieve data . /1359846974.Didn't retrieve data . /1359846971.Didn't retrieve data . /1359846968.Didn't retrieve data . /1359846965.Didn't retrieve data . /1359846859.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847040', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847037', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847034', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847005', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846977', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846974', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846971', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846968', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846965', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846859', None, None, None, None, None, '2913063') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013620138168334961 save_final save missing photos in datou_result : time spend for datou_step_exec : 121.72135591506958 time spend to save output : 0.018143653869628906 total time spend for step 3 : 121.73949956893921 step4:ventilate_hashtags_in_portfolio Tue May 20 20:15:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23179284 get user id for portfolio 23179284 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23179284 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_clair','background','pet_fonce','environnement','papier','autre','carton','flou','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23179284 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_clair','background','pet_fonce','environnement','papier','autre','carton','flou','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23179284 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_clair','background','pet_fonce','environnement','papier','autre','carton','flou','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23179728,23179729,23179730,23179731,23179732,23179733,23179734,23179735,23179736,23179737,23179738?tags=pehd,pet_clair,background,pet_fonce,environnement,papier,autre,carton,flou,mal_croppe,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359847040, 1359847037, 1359847034, 1359847005, 1359846977, 1359846974, 1359846971, 1359846968, 1359846965, 1359846859] Looping around the photos to save general results len do output : 1 /23179284. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847040', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847037', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847034', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847005', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846977', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846974', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846971', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846968', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846965', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846859', None, None, None, None, None, '2913063') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014219045639038086 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6506977081298828 time spend to save output : 0.014740943908691406 total time spend for step 4 : 1.6654386520385742 step5:final Tue May 20 20:15:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359847040: ('0.07927160493827161',), 1359847037: ('0.07927160493827161',), 1359847034: ('0.07927160493827161',), 1359847005: ('0.07927160493827161',), 1359846977: ('0.07927160493827161',), 1359846974: ('0.07927160493827161',), 1359846971: ('0.07927160493827161',), 1359846968: ('0.07927160493827161',), 1359846965: ('0.07927160493827161',), 1359846859: ('0.07927160493827161',)} new output for save of step final : {1359847040: ('0.07927160493827161',), 1359847037: ('0.07927160493827161',), 1359847034: ('0.07927160493827161',), 1359847005: ('0.07927160493827161',), 1359846977: ('0.07927160493827161',), 1359846974: ('0.07927160493827161',), 1359846971: ('0.07927160493827161',), 1359846968: ('0.07927160493827161',), 1359846965: ('0.07927160493827161',), 1359846859: ('0.07927160493827161',)} [1359847040, 1359847037, 1359847034, 1359847005, 1359846977, 1359846974, 1359846971, 1359846968, 1359846965, 1359846859] Looping around the photos to save general results len do output : 10 /1359847040.Didn't retrieve data . /1359847037.Didn't retrieve data . /1359847034.Didn't retrieve data . /1359847005.Didn't retrieve data . /1359846977.Didn't retrieve data . /1359846974.Didn't retrieve data . /1359846971.Didn't retrieve data . /1359846968.Didn't retrieve data . /1359846965.Didn't retrieve data . /1359846859.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847040', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847037', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847034', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847005', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846977', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846974', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846971', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846968', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846965', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846859', None, None, None, None, None, '2913063') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01331186294555664 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11821556091308594 time spend to save output : 0.01421213150024414 total time spend for step 5 : 0.13242769241333008 step6:blur_detection Tue May 20 20:15:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3.jpg resize: (2160, 3840) 1359847040 -5.693278282111703 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039.jpg resize: (2160, 3840) 1359847037 -6.203479154656305 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7.jpg resize: (2160, 3840) 1359847034 -6.204319235366337 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac.jpg resize: (2160, 3840) 1359847005 -6.132875211319436 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc.jpg resize: (2160, 3840) 1359846977 -6.183225507227937 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282.jpg resize: (2160, 3840) 1359846974 -6.388005642435624 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23.jpg resize: (2160, 3840) 1359846971 -6.329039314240447 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584.jpg resize: (2160, 3840) 1359846968 -6.258271931082104 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66.jpg resize: (2160, 3840) 1359846965 -5.824745292020643 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781.jpg resize: (2160, 3840) 1359846859 -5.701827670107687 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536595_0.png resize: (216, 246) 1359852027 -3.051535299338691 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536596_0.png resize: (130, 156) 1359852028 -3.939399103785077 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536599_0.png resize: (297, 407) 1359852030 -4.569580784909031 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536600_0.png resize: (139, 158) 1359852031 -3.438406195950909 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536609_0.png resize: (255, 138) 1359852032 -3.974494212419284 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536610_0.png resize: (156, 129) 1359852033 -2.948638037737108 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536612_0.png resize: (76, 112) 1359852035 -4.628460484812826 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536613_0.png resize: (177, 167) 1359852036 -4.473377570924859 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536615_0.png resize: (174, 252) 1359852037 -4.443250184338522 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536623_0.png resize: (435, 439) 1359852039 -3.4273827241660926 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536626_0.png resize: (177, 193) 1359852040 -3.213814144856357 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536627_0.png resize: (498, 395) 1359852041 -3.5135637413965446 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536628_0.png resize: (94, 212) 1359852043 -3.856682645368832 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536637_0.png resize: (158, 135) 1359852044 -4.826287259551808 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536638_0.png resize: (248, 199) 1359852045 -2.8923836287909492 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536639_0.png resize: (281, 300) 1359852047 -4.876959803193505 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536642_0.png resize: (211, 129) 1359852049 -4.066383831894172 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536643_0.png resize: (231, 150) 1359852050 -2.3268879421573154 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536645_0.png resize: (327, 191) 1359852051 -3.9469290091004474 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536646_0.png resize: (351, 228) 1359852054 -1.9585965466054431 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536648_0.png resize: (213, 219) 1359852055 -3.9742884301549863 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536650_0.png resize: (105, 234) 1359852056 -3.5403707558954887 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536654_0.png resize: (237, 233) 1359852057 -4.114701383262144 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536655_0.png resize: (128, 119) 1359852059 -3.744329083754717 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536656_0.png resize: (81, 126) 1359852060 0.36854969321159814 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536657_0.png resize: (257, 164) 1359852061 -4.340850355252805 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536658_0.png resize: (337, 231) 1359852063 -1.9647177676831602 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536659_0.png resize: (113, 111) 1359852064 -4.188166171900343 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536660_0.png resize: (470, 453) 1359852065 -3.6027202851546676 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536661_0.png resize: (90, 105) 1359852066 -4.094278501212528 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536666_0.png resize: (201, 308) 1359852068 -2.4441356473158242 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536670_0.png resize: (203, 143) 1359852069 -3.6666632173549734 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536671_0.png resize: (190, 260) 1359852071 -4.380793903397232 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536672_0.png resize: (165, 127) 1359852073 -4.22167320427903 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536675_0.png resize: (90, 165) 1359852074 -3.608625520834817 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536677_0.png resize: (298, 250) 1359852075 -1.6755948138662171 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536678_0.png resize: (254, 299) 1359852076 -3.122966581531526 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536680_0.png resize: (248, 190) 1359852078 -3.6326303607042014 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536683_0.png resize: (358, 444) 1359852079 -4.0684772257101365 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536684_0.png resize: (138, 78) 1359852080 -4.13950255156563 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536686_0.png resize: (349, 321) 1359852082 -2.8186013623671258 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536689_0.png resize: (210, 192) 1359852083 -2.893738067842008 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536696_0.png resize: (227, 105) 1359852084 -4.375108913639856 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536701_0.png resize: (244, 366) 1359852086 -3.7661395159795945 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536705_0.png resize: (155, 107) 1359852087 -3.6345936367201075 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536706_0.png resize: (183, 250) 1359852088 -3.4809651416852163 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536708_0.png resize: (198, 338) 1359852089 -3.7354759966553637 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536712_0.png resize: (59, 148) 1359852091 -3.230111535355377 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536714_0.png resize: (352, 168) 1359852092 -4.138569649772672 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536715_0.png resize: (309, 168) 1359852093 -4.368088496783495 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536716_0.png resize: (127, 108) 1359852095 -4.154858627265944 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536717_0.png resize: (65, 112) 1359852096 -4.41898599770571 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536720_0.png resize: (126, 124) 1359852097 -2.9563340413359644 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536606_0.png resize: (614, 341) 1359852209 -4.772596929035945 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536618_0.png resize: (205, 191) 1359852210 -3.484760420420397 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536624_0.png resize: (344, 152) 1359852211 -3.871685752439167 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536629_0.png resize: (213, 135) 1359852213 -2.3178914434131497 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536630_0.png resize: (152, 157) 1359852214 -3.4347586135438655 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536632_0.png resize: (170, 163) 1359852215 -2.6188454100394147 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536633_0.png resize: (140, 139) 1359852218 -3.5033129039473274 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536636_0.png resize: (182, 132) 1359852219 -3.570569854504595 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536662_0.png resize: (138, 293) 1359852220 -3.0978464024988175 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536669_0.png resize: (204, 255) 1359852221 -3.727651854899946 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536673_0.png resize: (755, 690) 1359852223 -3.60506450669139 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536687_0.png resize: (419, 486) 1359852224 -4.745830785088928 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536691_0.png resize: (217, 248) 1359852225 -3.2662355541507124 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536693_0.png resize: (555, 658) 1359852227 -3.0567235129618235 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536694_0.png resize: (256, 184) 1359852228 -4.450686114815323 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536697_0.png resize: (219, 147) 1359852229 -2.5242682120718 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536698_0.png resize: (174, 254) 1359852230 -4.021129523077497 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536700_0.png resize: (377, 261) 1359852232 -4.25527478769647 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536703_0.png resize: (227, 137) 1359852233 -3.2483991669405423 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536704_0.png resize: (267, 282) 1359852234 -4.629189060338071 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536718_0.png resize: (339, 161) 1359852236 -2.820662204433171 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536722_0.png resize: (467, 451) 1359852237 -3.4665079648162713 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536598_0.png resize: (147, 207) 1359852315 -3.9035778882132304 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536602_0.png resize: (269, 233) 1359852316 -4.883296129373672 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536604_0.png resize: (208, 188) 1359852317 -4.192557338251366 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536611_0.png resize: (119, 147) 1359852319 -3.8527021101075736 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536614_0.png resize: (297, 380) 1359852320 -3.9450355762528466 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536617_0.png resize: (132, 167) 1359852321 -3.999634219932131 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536622_0.png resize: (108, 119) 1359852323 -4.383325248754361 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536647_0.png resize: (151, 112) 1359852324 -3.935598580685249 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536649_0.png resize: (70, 150) 1359852325 -2.755687240225011 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536652_0.png resize: (176, 148) 1359852326 -4.366667912702263 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536664_0.png resize: (209, 162) 1359852328 -3.6359981944654174 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536679_0.png resize: (361, 174) 1359852329 -4.273682715603206 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536685_0.png resize: (147, 117) 1359852330 -3.635827608477162 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536688_0.png resize: (259, 189) 1359852332 -3.795805776157233 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536690_0.png resize: (243, 169) 1359852333 -3.678959433887075 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536709_0.png resize: (167, 102) 1359852334 -3.875474873064244 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536713_0.png resize: (116, 125) 1359852335 -3.9868145777710997 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536719_0.png resize: (125, 122) 1359852337 -3.918694339281958 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536723_0.png resize: (214, 215) 1359852338 -4.040992185203551 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536597_0.png resize: (708, 1197) 1359852411 -4.900885496619234 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536605_0.png resize: (311, 407) 1359852412 -5.606406032599176 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536607_0.png resize: (499, 288) 1359852413 -4.3502949347283675 treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536608_0.png resize: (666, 220) 1359852414 -3.24856913260832 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536616_0.png resize: (308, 304) 1359852415 -3.988991461273106 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536619_0.png resize: (191, 202) 1359852416 -3.472779527958671 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536620_0.png resize: (336, 252) 1359852417 -4.287963016690704 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536621_0.png resize: (184, 241) 1359852418 -4.476918316450577 treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536625_0.png resize: (250, 324) 1359852419 -4.8093424861385135 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536631_0.png resize: (183, 184) 1359852420 -2.701690382054118 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536634_0.png resize: (185, 183) 1359852421 -3.9971595436383955 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536640_0.png resize: (112, 178) 1359852422 -2.083828546797197 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536651_0.png resize: (397, 508) 1359852423 -5.271241283315222 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536653_0.png resize: (281, 253) 1359852424 -3.392678254348651 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536663_0.png resize: (120, 274) 1359852425 -3.2180150958705305 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536665_0.png resize: (308, 243) 1359852427 -4.31679807427596 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536667_0.png resize: (200, 115) 1359852428 -3.4058156676733216 treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536668_0.png resize: (640, 104) 1359852429 -4.265756611349643 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536676_0.png resize: (435, 292) 1359852430 -5.402877738617261 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536681_0.png resize: (265, 161) 1359852431 -4.321984836338482 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536682_0.png resize: (585, 740) 1359852432 -5.223785502140578 treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536692_0.png resize: (546, 375) 1359852433 -4.509852772623324 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536695_0.png resize: (359, 428) 1359852434 -4.953767139323825 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536702_0.png resize: (488, 234) 1359852435 -1.8634922817948338 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536710_0.png resize: (273, 304) 1359852436 -3.975062867948353 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536711_0.png resize: (304, 790) 1359852437 -3.5030398717354556 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536601_0.png resize: (161, 196) 1359852441 -3.2276698325043527 treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536635_0.png resize: (295, 260) 1359852442 -1.3051947842099554 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536641_0.png resize: (138, 155) 1359852443 -2.333821773659319 treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536644_0.png resize: (130, 136) 1359852444 -3.4746979971044913 treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536674_0.png resize: (119, 115) 1359852445 -4.366540687697509 treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536699_0.png resize: (297, 197) 1359852446 -4.142041092739064 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536707_0.png resize: (125, 114) 1359852447 -3.389221116564149 treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536721_0.png resize: (109, 105) 1359852448 -3.2799677924704644 treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536603_0.png resize: (147, 304) 1359852450 -4.863700843908304 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 139 time used for this insertion : 0.019675016403198242 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 139 time used for this insertion : 0.030236244201660156 save missing photos in datou_result : time spend for datou_step_exec : 47.11925983428955 time spend to save output : 0.05626845359802246 total time spend for step 6 : 47.17552828788757 step7:brightness Tue May 20 20:16:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3.jpg treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039.jpg treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7.jpg treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac.jpg treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc.jpg treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282.jpg treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23.jpg treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584.jpg treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66.jpg treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781.jpg treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536595_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536596_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536599_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536600_0.png treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536609_0.png treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536610_0.png treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536612_0.png treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536613_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536615_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536623_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536626_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536627_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536628_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536637_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536638_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536639_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536642_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536643_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536645_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536646_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536648_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536650_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536654_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536655_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536656_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536657_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536658_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536659_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536660_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536661_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536666_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536670_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536671_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536672_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536675_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536677_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536678_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536680_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536683_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536684_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536686_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536689_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536696_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536701_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536705_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536706_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536708_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536712_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536714_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536715_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536716_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536717_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536720_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536606_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536618_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536624_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536629_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536630_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536632_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536633_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536636_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536662_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536669_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536673_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536687_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536691_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536693_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536694_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536697_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536698_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536700_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536703_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536704_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536718_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536722_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536598_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536602_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536604_0.png treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536611_0.png treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536614_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536617_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536622_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536647_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536649_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536652_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536664_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536679_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536685_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536688_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536690_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536709_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536713_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536719_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536723_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536597_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536605_0.png treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536607_0.png treat image : temp/1747764627_3752496_1359847037_40524138e9f2b5e01aec03c2c4cc4039_rle_crop_3806536608_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536616_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536619_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536620_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536621_0.png treat image : temp/1747764627_3752496_1359847034_0e003039c514f1f8717025e2cf57adf7_rle_crop_3806536625_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536631_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536634_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536640_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536651_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536653_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536663_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536665_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536667_0.png treat image : temp/1747764627_3752496_1359846974_d7e01d8b51fb68c8a983dab5f8ac1282_rle_crop_3806536668_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536676_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536681_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536682_0.png treat image : temp/1747764627_3752496_1359846968_650d538eb1613e829503fbeb21735584_rle_crop_3806536692_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536695_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536702_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536710_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536711_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536601_0.png treat image : temp/1747764627_3752496_1359847005_9218404c2fe034c1c16e55969fa535ac_rle_crop_3806536635_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536641_0.png treat image : temp/1747764627_3752496_1359846977_a84716beb49db60a8cf35080dfb13cdc_rle_crop_3806536644_0.png treat image : temp/1747764627_3752496_1359846971_9b4fc695576b2c6044b2b140dc77fc23_rle_crop_3806536674_0.png treat image : temp/1747764627_3752496_1359846965_82c5da8c6b5b6109cfe501d37c80ab66_rle_crop_3806536699_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536707_0.png treat image : temp/1747764627_3752496_1359846859_6abe0614895496664cb6b8dcc24ca781_rle_crop_3806536721_0.png treat image : temp/1747764627_3752496_1359847040_b3758c01d7635877ede0579088b889a3_rle_crop_3806536603_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 139 time used for this insertion : 0.02259206771850586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 139 time used for this insertion : 0.0335392951965332 save missing photos in datou_result : time spend for datou_step_exec : 13.013224124908447 time spend to save output : 0.06177997589111328 total time spend for step 7 : 13.07500410079956 step8:velours_tree Tue May 20 20:16:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.4405708312988281 time spend to save output : 0.00024628639221191406 total time spend for step 8 : 0.44081711769104004 step9:send_mail_cod Tue May 20 20:16:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23179284_20-05-2025_20_16_37.pdf 23179728 imagette231797281747764997 23179729 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231797291747764997 23179730 imagette231797301747764998 23179731 change filename to text .imagette231797311747764998 23179733 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231797331747764998 23179734 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231797341747765000 23179735 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231797351747765000 23179736 imagette231797361747765002 23179737 imagette231797371747765002 23179738 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231797381747765002 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23179284 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23179728,23179729,23179730,23179731,23179732,23179733,23179734,23179735,23179736,23179737,23179738?tags=pehd,pet_clair,background,pet_fonce,environnement,papier,autre,carton,flou,mal_croppe,metal args[1359847040] : ((1359847040, -5.693278282111703, 492609224), (1359847040, -0.029512355678251685, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359847037] : ((1359847037, -6.203479154656305, 492609224), (1359847037, 0.1130813917311985, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359847034] : ((1359847034, -6.204319235366337, 492609224), (1359847034, 0.17310063991391403, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359847005] : ((1359847005, -6.132875211319436, 492609224), (1359847005, 0.1468702869338601, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359846977] : ((1359846977, -6.183225507227937, 492609224), (1359846977, 0.13749136812363444, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359846974] : ((1359846974, -6.388005642435624, 492609224), (1359846974, 0.1923092575772152, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359846971] : ((1359846971, -6.329039314240447, 492609224), (1359846971, 0.22201604467730918, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359846968] : ((1359846968, -6.258271931082104, 492609224), (1359846968, 0.2840993640097715, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359846965] : ((1359846965, -5.824745292020643, 492609224), (1359846965, 0.10865647677125287, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com args[1359846859] : ((1359846859, -5.701827670107687, 492609224), (1359846859, 0.038386622139002555, 2107752395), '0.07927160493827161') We are sending mail with results at report@fotonower.com refus_total : 0.07927160493827161 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23179284 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23179284_20-05-2025_20_16_37.pdf results_Auto_P23179284_20-05-2025_20_16_37.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23179284_20-05-2025_20_16_37.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23179284','results_Auto_P23179284_20-05-2025_20_16_37.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23179284_20-05-2025_20_16_37.pdf','pdf','','1.04','0.07927160493827161') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23179284

https://www.fotonower.com/image?json=false&list_photos_id=1359847040
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359847037
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359847034
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359847005
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359846977
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359846974
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359846971
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359846968
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359846965
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359846859
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 7.93%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/23179729?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23179731?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23179733?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23179734?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23179735?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23179738?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23179284_20-05-2025_20_16_37.pdf.

Lien vers velours :https://www.fotonower.com/velours/23179728,23179729,23179730,23179731,23179732,23179733,23179734,23179735,23179736,23179737,23179738?tags=pehd,pet_clair,background,pet_fonce,environnement,papier,autre,carton,flou,mal_croppe,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 20 May 2025 18:16:47 GMT Content-Length: 0 Connection: close X-Message-Id: 3LHDcyU-S4CLztOV8AonTQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359847040, 1359847037, 1359847034, 1359847005, 1359846977, 1359846974, 1359846971, 1359846968, 1359846965, 1359846859] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847040', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847037', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847034', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847005', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846977', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846974', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846971', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846968', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846965', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846859', None, None, None, None, None, '2913063') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01752448081970215 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.774250030517578 time spend to save output : 0.017741918563842773 total time spend for step 9 : 10.791991949081421 step10:split_time_score Tue May 20 20:16:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20052025 23179284 Nombre de photos uploadées : 10 / 23040 (0%) 20052025 23179284 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 20052025 23179284 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 3.314018249511719e-05 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0013988018035888672 elapsed_time : insert_dashboard_record_day_entry 0.02706456184387207 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09201400421027917 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157181_20-05-2025_08_46_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157181 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157181 AND mptpi.`type`=3594 To do Qualite : 0.10180426772060878 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157188_20-05-2025_08_35_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157188 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157188 AND mptpi.`type`=3594 To do Qualite : 0.09871742380401231 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157192_20-05-2025_08_28_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157192 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157192 AND mptpi.`type`=3594 To do Qualite : 0.10408518822159352 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23161557_20-05-2025_10_30_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23161557 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23161557 AND mptpi.`type`=3594 To do Qualite : 0.1308608699845679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23164737_20-05-2025_11_54_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23164737 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23164737 AND mptpi.`type`=3594 To do Qualite : 0.1064864810896508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23164744_20-05-2025_12_03_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23164744 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23164744 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170102 order by id desc limit 1 Qualite : 0.11795572916666669 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170104_20-05-2025_15_34_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170104 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170104 AND mptpi.`type`=3594 To do Qualite : 0.02726871178050528 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23166958_20-05-2025_13_30_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23166958 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23166958 AND mptpi.`type`=3726 To do Qualite : 0.09543954354745371 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23166961_20-05-2025_13_20_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23166961 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23166961 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170110 order by id desc limit 1 Qualite : 0.10659472484016758 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170112_20-05-2025_15_29_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170112 AND mptpi.`type`=3594 To do Qualite : 0.11812746691001888 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23171910_20-05-2025_17_03_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23171910 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23171910 AND mptpi.`type`=3594 To do Qualite : 0.19817297078617974 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172899_20-05-2025_16_57_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172899 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172899 AND mptpi.`type`=3594 To do Qualite : 0.20049805783529734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172907_20-05-2025_16_49_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172907 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23176165 order by id desc limit 1 Qualite : 0.14197543925218625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23176167_20-05-2025_18_56_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23176167 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23176167 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23179278 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23179281 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23179282 order by id desc limit 1 Qualite : 0.07927160493827161 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23179284_20-05-2025_20_16_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23179284 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23179284 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20052025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359847040, 1359847037, 1359847034, 1359847005, 1359846977, 1359846974, 1359846971, 1359846968, 1359846965, 1359846859] Looping around the photos to save general results len do output : 1 /23179284Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847040', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847037', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847034', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359847005', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846977', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846974', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846971', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846968', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846965', None, None, None, None, None, '2913063') ('3318', None, None, None, None, None, None, None, '2913063') ('3318', '23179284', '1359846859', None, None, None, None, None, '2913063') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013042449951171875 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.5079333782196045 time spend to save output : 0.01324772834777832 total time spend for step 10 : 6.521181106567383 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 150.51user 183.70system 6:30.30elapsed 85%CPU (0avgtext+0avgdata 6054588maxresident)k 2576800inputs+144784outputs (24805major+16045899minor)pagefaults 0swaps