python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 378906 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4018171'] with mtr_portfolio_ids : ['28318855'] and first list_photo_ids : [] new path : /proc/378906/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 31 ; length of list_pids : 31 ; length of list_args : 31 time to download the photos : 5.68441367149353 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Nov 7 19:20:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-07 19:20:35.795426: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-07 19:20:35.826494: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-07 19:20:35.828863: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f73c8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-07 19:20:35.828945: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-07 19:20:35.833930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-07 19:20:36.075127: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1c9d09c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-07 19:20:36.075184: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-07 19:20:36.076691: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-07 19:20:36.077147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-07 19:20:36.080301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-07 19:20:36.086064: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-07 19:20:36.086529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-07 19:20:36.094708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-07 19:20:36.096712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-07 19:20:36.116860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-07 19:20:36.118887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-07 19:20:36.119000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-07 19:20:36.120183: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-07 19:20:36.120215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-07 19:20:36.120231: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-07 19:20:36.122392: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-07 19:20:36.381041: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-07 19:20:36.381131: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-07 19:20:36.381150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-07 19:20:36.381165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-07 19:20:36.381179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-07 19:20:36.381194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-07 19:20:36.381209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-07 19:20:36.381223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-07 19:20:36.382537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-07 19:20:36.383681: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-07 19:20:36.383711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-07 19:20:36.383727: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-07 19:20:36.383741: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-07 19:20:36.383755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-07 19:20:36.383768: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-07 19:20:36.383782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-07 19:20:36.383796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-07 19:20:36.385037: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-07 19:20:36.385065: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-07 19:20:36.385074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-07 19:20:36.385081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-07 19:20:36.386435: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-07 19:20:45.877556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-07 19:20:46.079504: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 31 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 379585 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 196 tf kernel not reseted sub process len(results) : 31 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 31 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0002830028533935547 nb_pixel_total : 7981 time to create 1 rle with old method : 0.010144472122192383 length of segment : 202 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 11050 time to create 1 rle with old method : 0.019080400466918945 length of segment : 129 time for calcul the mask position with numpy : 0.00036072731018066406 nb_pixel_total : 9811 time to create 1 rle with old method : 0.013886213302612305 length of segment : 142 time for calcul the mask position with numpy : 0.0006337165832519531 nb_pixel_total : 21825 time to create 1 rle with old method : 0.02644801139831543 length of segment : 193 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 17348 time to create 1 rle with old method : 0.020264387130737305 length of segment : 435 time for calcul the mask position with numpy : 0.013364076614379883 nb_pixel_total : 756302 time to create 1 rle with new method : 0.2558426856994629 length of segment : 932 time for calcul the mask position with numpy : 0.003114938735961914 nb_pixel_total : 225782 time to create 1 rle with new method : 0.005877256393432617 length of segment : 378 time for calcul the mask position with numpy : 0.01238250732421875 nb_pixel_total : 716709 time to create 1 rle with new method : 0.019727468490600586 length of segment : 877 time for calcul the mask position with numpy : 0.001589059829711914 nb_pixel_total : 97140 time to create 1 rle with old method : 0.10342788696289062 length of segment : 533 time for calcul the mask position with numpy : 0.0013837814331054688 nb_pixel_total : 96079 time to create 1 rle with old method : 0.10779452323913574 length of segment : 498 time for calcul the mask position with numpy : 0.0002110004425048828 nb_pixel_total : 12217 time to create 1 rle with old method : 0.014039278030395508 length of segment : 117 time for calcul the mask position with numpy : 0.00033974647521972656 nb_pixel_total : 14366 time to create 1 rle with old method : 0.017325639724731445 length of segment : 165 time for calcul the mask position with numpy : 0.0001385211944580078 nb_pixel_total : 6491 time to create 1 rle with old method : 0.0075435638427734375 length of segment : 114 time for calcul the mask position with numpy : 0.00010037422180175781 nb_pixel_total : 4760 time to create 1 rle with old method : 0.00599217414855957 length of segment : 59 time for calcul the mask position with numpy : 0.0003917217254638672 nb_pixel_total : 8564 time to create 1 rle with old method : 0.011050939559936523 length of segment : 129 time for calcul the mask position with numpy : 0.0003509521484375 nb_pixel_total : 7542 time to create 1 rle with old method : 0.008739709854125977 length of segment : 106 time for calcul the mask position with numpy : 0.0032601356506347656 nb_pixel_total : 112650 time to create 1 rle with old method : 0.12312936782836914 length of segment : 556 time for calcul the mask position with numpy : 0.00028252601623535156 nb_pixel_total : 1578 time to create 1 rle with old method : 0.0018413066864013672 length of segment : 105 time for calcul the mask position with numpy : 0.0004930496215820312 nb_pixel_total : 14661 time to create 1 rle with old method : 0.016064882278442383 length of segment : 165 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 7155 time to create 1 rle with old method : 0.008385896682739258 length of segment : 110 time for calcul the mask position with numpy : 0.002522706985473633 nb_pixel_total : 111013 time to create 1 rle with old method : 0.12031865119934082 length of segment : 531 time for calcul the mask position with numpy : 0.0016369819641113281 nb_pixel_total : 112643 time to create 1 rle with old method : 0.15035676956176758 length of segment : 528 time for calcul the mask position with numpy : 0.0002846717834472656 nb_pixel_total : 6429 time to create 1 rle with old method : 0.007157802581787109 length of segment : 110 time for calcul the mask position with numpy : 0.022001266479492188 nb_pixel_total : 861017 time to create 1 rle with new method : 0.07867622375488281 length of segment : 1194 time for calcul the mask position with numpy : 0.00067901611328125 nb_pixel_total : 9878 time to create 1 rle with old method : 0.01605963706970215 length of segment : 96 time for calcul the mask position with numpy : 0.00031065940856933594 nb_pixel_total : 7778 time to create 1 rle with old method : 0.009177446365356445 length of segment : 130 time for calcul the mask position with numpy : 0.0025789737701416016 nb_pixel_total : 112753 time to create 1 rle with old method : 0.12421584129333496 length of segment : 534 time for calcul the mask position with numpy : 0.0150604248046875 nb_pixel_total : 1159623 time to create 1 rle with new method : 0.11404275894165039 length of segment : 1450 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 4629 time to create 1 rle with old method : 0.006711721420288086 length of segment : 48 time for calcul the mask position with numpy : 0.0002789497375488281 nb_pixel_total : 12414 time to create 1 rle with old method : 0.01537179946899414 length of segment : 91 time for calcul the mask position with numpy : 0.001953125 nb_pixel_total : 110220 time to create 1 rle with old method : 0.12971711158752441 length of segment : 481 time for calcul the mask position with numpy : 0.018991708755493164 nb_pixel_total : 833676 time to create 1 rle with new method : 0.2592141628265381 length of segment : 1396 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0017383098602294922 length of segment : 47 time for calcul the mask position with numpy : 0.00028777122497558594 nb_pixel_total : 14057 time to create 1 rle with old method : 0.01679396629333496 length of segment : 143 time for calcul the mask position with numpy : 0.00020503997802734375 nb_pixel_total : 7875 time to create 1 rle with old method : 0.009819507598876953 length of segment : 122 time for calcul the mask position with numpy : 0.00017905235290527344 nb_pixel_total : 5838 time to create 1 rle with old method : 0.007556915283203125 length of segment : 129 time for calcul the mask position with numpy : 0.00955820083618164 nb_pixel_total : 724703 time to create 1 rle with new method : 0.12458395957946777 length of segment : 927 time for calcul the mask position with numpy : 0.001493215560913086 nb_pixel_total : 100267 time to create 1 rle with old method : 0.1228189468383789 length of segment : 240 time for calcul the mask position with numpy : 0.002164125442504883 nb_pixel_total : 109230 time to create 1 rle with old method : 0.12995243072509766 length of segment : 503 time for calcul the mask position with numpy : 0.0005548000335693359 nb_pixel_total : 30103 time to create 1 rle with old method : 0.04036736488342285 length of segment : 269 time for calcul the mask position with numpy : 0.0002713203430175781 nb_pixel_total : 7266 time to create 1 rle with old method : 0.009247779846191406 length of segment : 113 time for calcul the mask position with numpy : 0.00019693374633789062 nb_pixel_total : 3520 time to create 1 rle with old method : 0.004486799240112305 length of segment : 131 time for calcul the mask position with numpy : 0.012097597122192383 nb_pixel_total : 812120 time to create 1 rle with new method : 0.03845834732055664 length of segment : 975 time for calcul the mask position with numpy : 0.0004987716674804688 nb_pixel_total : 20244 time to create 1 rle with old method : 0.033963918685913086 length of segment : 218 time for calcul the mask position with numpy : 0.000385284423828125 nb_pixel_total : 10532 time to create 1 rle with old method : 0.01327371597290039 length of segment : 181 time for calcul the mask position with numpy : 0.001795053482055664 nb_pixel_total : 105892 time to create 1 rle with old method : 0.11793994903564453 length of segment : 526 time for calcul the mask position with numpy : 0.01098179817199707 nb_pixel_total : 918277 time to create 1 rle with new method : 0.04361557960510254 length of segment : 1483 time for calcul the mask position with numpy : 0.0017240047454833984 nb_pixel_total : 109873 time to create 1 rle with old method : 0.12234616279602051 length of segment : 578 time for calcul the mask position with numpy : 0.0004303455352783203 nb_pixel_total : 23004 time to create 1 rle with old method : 0.025934696197509766 length of segment : 281 time for calcul the mask position with numpy : 0.21023845672607422 nb_pixel_total : 1169848 time to create 1 rle with new method : 0.42771267890930176 length of segment : 1616 time for calcul the mask position with numpy : 0.0002567768096923828 nb_pixel_total : 9657 time to create 1 rle with old method : 0.01157522201538086 length of segment : 134 time for calcul the mask position with numpy : 0.0003559589385986328 nb_pixel_total : 18077 time to create 1 rle with old method : 0.021456241607666016 length of segment : 120 time for calcul the mask position with numpy : 0.0001838207244873047 nb_pixel_total : 5414 time to create 1 rle with old method : 0.0064465999603271484 length of segment : 124 time for calcul the mask position with numpy : 0.0002658367156982422 nb_pixel_total : 9586 time to create 1 rle with old method : 0.011384010314941406 length of segment : 131 time for calcul the mask position with numpy : 0.00023937225341796875 nb_pixel_total : 6729 time to create 1 rle with old method : 0.008732795715332031 length of segment : 119 time for calcul the mask position with numpy : 0.001901388168334961 nb_pixel_total : 88392 time to create 1 rle with old method : 0.09920644760131836 length of segment : 494 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 4478 time to create 1 rle with old method : 0.005545616149902344 length of segment : 88 time for calcul the mask position with numpy : 0.014962434768676758 nb_pixel_total : 727826 time to create 1 rle with new method : 0.05703139305114746 length of segment : 996 time for calcul the mask position with numpy : 0.0008718967437744141 nb_pixel_total : 47611 time to create 1 rle with old method : 0.054125308990478516 length of segment : 314 time for calcul the mask position with numpy : 0.00011348724365234375 nb_pixel_total : 3763 time to create 1 rle with old method : 0.004507541656494141 length of segment : 56 time for calcul the mask position with numpy : 0.0010921955108642578 nb_pixel_total : 55628 time to create 1 rle with old method : 0.06455731391906738 length of segment : 280 time for calcul the mask position with numpy : 0.00028324127197265625 nb_pixel_total : 11970 time to create 1 rle with old method : 0.0142059326171875 length of segment : 107 time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 9252 time to create 1 rle with old method : 0.011641740798950195 length of segment : 137 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 43544 time to create 1 rle with old method : 0.05797886848449707 length of segment : 353 time for calcul the mask position with numpy : 0.002448558807373047 nb_pixel_total : 102618 time to create 1 rle with old method : 0.11574292182922363 length of segment : 592 time for calcul the mask position with numpy : 0.024962663650512695 nb_pixel_total : 874615 time to create 1 rle with new method : 0.26055431365966797 length of segment : 1485 time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 5658 time to create 1 rle with old method : 0.006806612014770508 length of segment : 108 time for calcul the mask position with numpy : 0.0002636909484863281 nb_pixel_total : 3493 time to create 1 rle with old method : 0.004712581634521484 length of segment : 75 time for calcul the mask position with numpy : 0.0002887248992919922 nb_pixel_total : 4446 time to create 1 rle with old method : 0.005476713180541992 length of segment : 99 time for calcul the mask position with numpy : 0.01783275604248047 nb_pixel_total : 732285 time to create 1 rle with new method : 0.05472826957702637 length of segment : 980 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 15321 time to create 1 rle with old method : 0.018785953521728516 length of segment : 221 time for calcul the mask position with numpy : 0.01749897003173828 nb_pixel_total : 850500 time to create 1 rle with new method : 0.030626296997070312 length of segment : 1206 time for calcul the mask position with numpy : 0.002524852752685547 nb_pixel_total : 115380 time to create 1 rle with old method : 0.12878823280334473 length of segment : 550 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 13160 time to create 1 rle with old method : 0.015100240707397461 length of segment : 151 time for calcul the mask position with numpy : 0.000759124755859375 nb_pixel_total : 29192 time to create 1 rle with old method : 0.032448530197143555 length of segment : 257 time for calcul the mask position with numpy : 0.01592707633972168 nb_pixel_total : 768892 time to create 1 rle with new method : 0.025067806243896484 length of segment : 997 time for calcul the mask position with numpy : 0.0018355846405029297 nb_pixel_total : 97953 time to create 1 rle with old method : 0.12166070938110352 length of segment : 478 time for calcul the mask position with numpy : 0.0024955272674560547 nb_pixel_total : 109576 time to create 1 rle with old method : 0.12841010093688965 length of segment : 528 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 6093 time to create 1 rle with old method : 0.007832050323486328 length of segment : 111 time for calcul the mask position with numpy : 0.013934612274169922 nb_pixel_total : 831755 time to create 1 rle with new method : 0.13207054138183594 length of segment : 1013 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 8529 time to create 1 rle with old method : 0.010080575942993164 length of segment : 115 time for calcul the mask position with numpy : 0.00012111663818359375 nb_pixel_total : 2671 time to create 1 rle with old method : 0.003407001495361328 length of segment : 47 time for calcul the mask position with numpy : 0.0019881725311279297 nb_pixel_total : 105743 time to create 1 rle with old method : 0.11731243133544922 length of segment : 569 time spent for convertir_results : 9.8988618850708 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 83 chid ids of type : 3594 Number RLEs to save : 34051 save missing photos in datou_result : time spend for datou_step_exec : 44.67512130737305 time spend to save output : 2.2175452709198 total time spend for step 1 : 46.89266657829285 step2:crop_condition Fri Nov 7 19:21:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 31 ! batch 1 Loaded 83 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762539681_378906 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152773_2523e90b36e426300ab254daa5261fb7_rle_crop_4025582958_0.png', 0, 99, 202, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582970_0.png', 0, 84, 114, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582971_0.png', 0, 113, 58, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582972_0.png', 0, 93, 129, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582975_0.png', 0, 44, 105, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582977_0.png', 0, 89, 110, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582983_0.png', 0, 94, 122, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582990_0.png', 0, 38, 47, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582991_0.png', 0, 157, 131, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582992_0.png', 0, 100, 118, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025582998_0.png', 0, 145, 113, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151170_e01ce14f2e8eb9fba4ac1ec210c6e2cd_rle_crop_4025583002_0.png', 0, 139, 154, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583010_0.png', 0, 62, 124, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150261_ac3ff0cbe4c30d6fd6eaa9dd669bc45c_rle_crop_4025583012_0.png', 0, 85, 119, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149188_bbe26a01e9d0ced6749c4d421954362f_rle_crop_4025583024_0.png', 0, 79, 108, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583026_0.png', 0, 99, 99, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583038_0.png', 0, 133, 103, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539685), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583039_0.png', 0, 81, 46, 0, 1762539685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.811138391494751 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762539689_378906 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152773_2523e90b36e426300ab254daa5261fb7_rle_crop_4025582959_0.png', 0, 124, 126, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582969_0.png', 0, 122, 160, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582976_0.png', 0, 117, 160, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582979_0.png', 0, 336, 526, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151718_9ef3d840a06610d4c7feab37ae25e6a7_rle_crop_4025582980_0.png', 0, 78, 110, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583005_0.png', 0, 335, 536, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583008_0.png', 0, 115, 134, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583011_0.png', 0, 101, 122, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583022_0.png', 0, 357, 536, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539690), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148629_bb6d947878e785a2dec733189768bac0_rle_crop_4025583036_0.png', 0, 75, 111, 0, 1762539690,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.527613401412964 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 3736932 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762539752_378906 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582960_0.png', 0, 80, 142, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582961_0.png', 0, 282, 154, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582962_0.png', 0, 127, 255, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582963_0.png', 0, 1090, 929, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582964_0.png', 0, 710, 368, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582965_0.png', 0, 1022, 876, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582966_0.png', 0, 309, 523, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582967_0.png', 0, 324, 470, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582968_0.png', 0, 147, 117, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582974_0.png', 0, 341, 551, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582978_0.png', 0, 337, 530, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151718_9ef3d840a06610d4c7feab37ae25e6a7_rle_crop_4025582981_0.png', 0, 1202, 989, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582982_0.png', 0, 127, 95, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582984_0.png', 0, 384, 509, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582985_0.png', 0, 1548, 919, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151567_e08eab10a8cc01195b314d5fe2f8d41d_rle_crop_4025582986_0.png', 0, 113, 48, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582987_0.png', 0, 173, 88, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582988_0.png', 0, 356, 478, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582989_0.png', 0, 1155, 1005, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582993_0.png', 0, 75, 105, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151361_b3202685b7f47097c8895437b567c8ff_rle_crop_4025582994_0.png', 0, 977, 923, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151361_b3202685b7f47097c8895437b567c8ff_rle_crop_4025582995_0.png', 0, 578, 239, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151316_37c2ad77407d3449de55d303d5acd3b9_rle_crop_4025582996_0.png', 0, 344, 503, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151316_37c2ad77407d3449de55d303d5acd3b9_rle_crop_4025582997_0.png', 0, 182, 267, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025583000_0.png', 0, 1189, 965, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025583001_0.png', 0, 196, 152, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151170_e01ce14f2e8eb9fba4ac1ec210c6e2cd_rle_crop_4025583003_0.png', 0, 340, 525, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150532_8a3d501896d7638f257f4740bf780238_rle_crop_4025583004_0.png', 0, 1299, 1000, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583006_0.png', 0, 148, 255, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583007_0.png', 0, 1342, 991, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583009_0.png', 0, 230, 120, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583013_0.png', 0, 338, 484, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583014_0.png', 0, 67, 87, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583015_0.png', 0, 1005, 993, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583016_0.png', 0, 203, 313, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150113_259142655aaf8b6feeeed49d9ed00060_rle_crop_4025583017_0.png', 0, 80, 56, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393150113_259142655aaf8b6feeeed49d9ed00060_rle_crop_4025583018_0.png', 0, 284, 277, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583019_0.png', 0, 183, 107, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583020_0.png', 0, 95, 137, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149188_bbe26a01e9d0ced6749c4d421954362f_rle_crop_4025583023_0.png', 0, 1175, 987, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583025_0.png', 0, 60, 74, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583027_0.png', 0, 978, 975, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583028_0.png', 0, 166, 221, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583029_0.png', 0, 1366, 785, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583030_0.png', 0, 347, 543, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149020_73febe18ddb4819ead10ed0843e2f5cb_rle_crop_4025583031_0.png', 0, 116, 151, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583032_0.png', 0, 181, 231, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583033_0.png', 0, 1077, 992, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583034_0.png', 0, 314, 476, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148629_bb6d947878e785a2dec733189768bac0_rle_crop_4025583035_0.png', 0, 350, 525, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583037_0.png', 0, 1177, 996, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539762), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393148503_10b86e63c03f48e13d90d1befdbe6223_rle_crop_4025583040_0.png', 0, 346, 536, 0, 1762539762,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 52 photos in the portfolio 3736932 time of upload the photos Elapsed time : 16.391788721084595 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762539769_378906 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539770), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582973_0.png', 0, 97, 102, 0, 1762539770,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539770), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025582999_0.png', 0, 40, 131, 0, 1762539770,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762539770), 0.0, 0.0, 14, '', 0, 0, '1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583021_0.png', 0, 156, 326, 0, 1762539770,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9601476192474365 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1393152773, 1393152739, 1393152672, 1393152608, 1393151813, 1393151776, 1393151718, 1393151653, 1393151601, 1393151567, 1393151440, 1393151403, 1393151361, 1393151316, 1393151249, 1393151170, 1393150532, 1393150441, 1393150353, 1393150261, 1393150172, 1393150113, 1393149190, 1393149188, 1393149169, 1393149091, 1393149020, 1393148974, 1393148629, 1393148575, 1393148503] Looping around the photos to save general results len do output : 83 /1393205556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393205685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393206152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152773', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152739', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152672', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152608', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151813', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151776', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151718', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151653', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151601', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151567', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151440', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151403', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151361', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151316', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151249', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151170', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150532', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150441', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150353', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150261', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150172', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150113', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149190', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149188', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149169', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149091', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149020', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148974', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148629', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148575', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148503', None, None, None, None, None, '4018171') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 280 time used for this insertion : 0.038068532943725586 save_final save missing photos in datou_result : time spend for datou_step_exec : 90.67094111442566 time spend to save output : 0.04082918167114258 total time spend for step 2 : 90.7117702960968 step3:rle_unique_nms_with_priority Fri Nov 7 19:22:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 83 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.13437533378601074 time for calcul the mask position with numpy : 0.11450076103210449 nb_pixel_total : 2054569 time to create 1 rle with new method : 0.08686614036560059 time for calcul the mask position with numpy : 0.0064923763275146484 nb_pixel_total : 11050 time to create 1 rle with old method : 0.013176202774047852 time for calcul the mask position with numpy : 0.006233930587768555 nb_pixel_total : 7981 time to create 1 rle with old method : 0.011892080307006836 create new chi : 0.24986720085144043 time to delete rle : 0.02414870262145996 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1742 TO DO : save crop sub photo not yet done ! save time : 0.20020365715026855 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.2144770622253418 time for calcul the mask position with numpy : 0.04058670997619629 nb_pixel_total : 1268314 time to create 1 rle with new method : 0.20343422889709473 time for calcul the mask position with numpy : 0.01584005355834961 nb_pixel_total : 756302 time to create 1 rle with new method : 0.15787172317504883 time for calcul the mask position with numpy : 0.006223440170288086 nb_pixel_total : 17348 time to create 1 rle with old method : 0.02051258087158203 time for calcul the mask position with numpy : 0.00704193115234375 nb_pixel_total : 21825 time to create 1 rle with old method : 0.028004884719848633 time for calcul the mask position with numpy : 0.006598234176635742 nb_pixel_total : 9811 time to create 1 rle with old method : 0.011400699615478516 create new chi : 0.5067002773284912 time to delete rle : 0.0007252693176269531 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 4484 TO DO : save crop sub photo not yet done ! save time : 0.41723108291625977 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06066703796386719 time for calcul the mask position with numpy : 0.013067245483398438 nb_pixel_total : 1033969 time to create 1 rle with new method : 0.05623793601989746 time for calcul the mask position with numpy : 0.006689310073852539 nb_pixel_total : 97140 time to create 1 rle with old method : 0.11574149131774902 time for calcul the mask position with numpy : 0.015250444412231445 nb_pixel_total : 716709 time to create 1 rle with new method : 0.07608509063720703 time for calcul the mask position with numpy : 0.012166976928710938 nb_pixel_total : 225782 time to create 1 rle with new method : 0.028167009353637695 create new chi : 0.3309319019317627 time to delete rle : 0.0011129379272460938 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4656 TO DO : save crop sub photo not yet done ! save time : 0.5513119697570801 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.4807603359222412 time for calcul the mask position with numpy : 0.07098197937011719 nb_pixel_total : 1939687 time to create 1 rle with new method : 0.1822049617767334 time for calcul the mask position with numpy : 0.006306648254394531 nb_pixel_total : 4760 time to create 1 rle with old method : 0.00539708137512207 time for calcul the mask position with numpy : 0.0066373348236083984 nb_pixel_total : 6491 time to create 1 rle with old method : 0.007357120513916016 time for calcul the mask position with numpy : 0.006494998931884766 nb_pixel_total : 14366 time to create 1 rle with old method : 0.01720714569091797 time for calcul the mask position with numpy : 0.007482290267944336 nb_pixel_total : 12217 time to create 1 rle with old method : 0.014042139053344727 time for calcul the mask position with numpy : 0.0072269439697265625 nb_pixel_total : 96079 time to create 1 rle with old method : 0.1080782413482666 create new chi : 0.45329952239990234 time to delete rle : 0.0004506111145019531 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2986 TO DO : save crop sub photo not yet done ! save time : 0.23690462112426758 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.09263777732849121 time for calcul the mask position with numpy : 0.13013505935668945 nb_pixel_total : 1928605 time to create 1 rle with new method : 0.08137202262878418 time for calcul the mask position with numpy : 0.006345987319946289 nb_pixel_total : 14661 time to create 1 rle with old method : 0.01676154136657715 time for calcul the mask position with numpy : 0.006174802780151367 nb_pixel_total : 1578 time to create 1 rle with old method : 0.0019004344940185547 time for calcul the mask position with numpy : 0.0066721439361572266 nb_pixel_total : 112650 time to create 1 rle with old method : 0.12441658973693848 time for calcul the mask position with numpy : 0.0060617923736572266 nb_pixel_total : 7542 time to create 1 rle with old method : 0.008978605270385742 time for calcul the mask position with numpy : 0.006203413009643555 nb_pixel_total : 8564 time to create 1 rle with old method : 0.010133028030395508 create new chi : 0.4160768985748291 time to delete rle : 0.0005946159362792969 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3202 TO DO : save crop sub photo not yet done ! save time : 0.24355316162109375 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04682660102844238 time for calcul the mask position with numpy : 0.019348621368408203 nb_pixel_total : 1951131 time to create 1 rle with new method : 0.08098220825195312 time for calcul the mask position with numpy : 0.0066378116607666016 nb_pixel_total : 4301 time to create 1 rle with old method : 0.007592201232910156 time for calcul the mask position with numpy : 0.01226186752319336 nb_pixel_total : 111013 time to create 1 rle with old method : 0.12434768676757812 time for calcul the mask position with numpy : 0.006482839584350586 nb_pixel_total : 7155 time to create 1 rle with old method : 0.008594989776611328 create new chi : 0.27556347846984863 time to delete rle : 0.0004749298095703125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2668 TO DO : save crop sub photo not yet done ! save time : 0.23459959030151367 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.09438157081604004 time for calcul the mask position with numpy : 0.12581777572631836 nb_pixel_total : 1206154 time to create 1 rle with new method : 0.08347749710083008 time for calcul the mask position with numpy : 0.015207052230834961 nb_pixel_total : 861017 time to create 1 rle with new method : 0.1466374397277832 time for calcul the mask position with numpy : 0.0060842037200927734 nb_pixel_total : 6429 time to create 1 rle with old method : 0.007676124572753906 create new chi : 0.3945302963256836 time to delete rle : 0.0005705356597900391 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 3688 TO DO : save crop sub photo not yet done ! save time : 0.29427671432495117 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.19795680046081543 time for calcul the mask position with numpy : 0.011798858642578125 nb_pixel_total : 792637 time to create 1 rle with new method : 0.08350348472595215 time for calcul the mask position with numpy : 0.14948081970214844 nb_pixel_total : 1150554 time to create 1 rle with new method : 0.07648754119873047 time for calcul the mask position with numpy : 0.006693840026855469 nb_pixel_total : 112753 time to create 1 rle with old method : 0.12976360321044922 time for calcul the mask position with numpy : 0.0065271854400634766 nb_pixel_total : 7778 time to create 1 rle with old method : 0.009305238723754883 time for calcul the mask position with numpy : 0.0063359737396240234 nb_pixel_total : 9878 time to create 1 rle with old method : 0.011780500411987305 create new chi : 0.5067403316497803 time to delete rle : 0.0008664131164550781 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 5452 TO DO : save crop sub photo not yet done ! save time : 0.39974069595336914 No data in photo_id : 1393151601 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03523993492126465 time for calcul the mask position with numpy : 0.020322084426879883 nb_pixel_total : 2068971 time to create 1 rle with new method : 0.1501622200012207 time for calcul the mask position with numpy : 0.006507158279418945 nb_pixel_total : 4629 time to create 1 rle with old method : 0.0055239200592041016 create new chi : 0.18273544311523438 time to delete rle : 0.00022101402282714844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1176 TO DO : save crop sub photo not yet done ! save time : 0.13682150840759277 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.13345861434936523 time for calcul the mask position with numpy : 0.040665626525878906 nb_pixel_total : 1117290 time to create 1 rle with new method : 0.2624678611755371 time for calcul the mask position with numpy : 0.011744499206542969 nb_pixel_total : 833676 time to create 1 rle with new method : 0.1497645378112793 time for calcul the mask position with numpy : 0.010674238204956055 nb_pixel_total : 110220 time to create 1 rle with old method : 0.1251511573791504 time for calcul the mask position with numpy : 0.010332345962524414 nb_pixel_total : 12414 time to create 1 rle with old method : 0.014735698699951172 create new chi : 0.6347651481628418 time to delete rle : 0.0009090900421142578 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 5016 TO DO : save crop sub photo not yet done ! save time : 0.3880434036254883 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07555818557739258 time for calcul the mask position with numpy : 0.06657147407531738 nb_pixel_total : 2044500 time to create 1 rle with new method : 0.18700170516967773 time for calcul the mask position with numpy : 0.006191253662109375 nb_pixel_total : 5838 time to create 1 rle with old method : 0.007073640823364258 time for calcul the mask position with numpy : 0.006098031997680664 nb_pixel_total : 7875 time to create 1 rle with old method : 0.009164810180664062 time for calcul the mask position with numpy : 0.00726628303527832 nb_pixel_total : 14057 time to create 1 rle with old method : 0.01640152931213379 time for calcul the mask position with numpy : 0.006232261657714844 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0016095638275146484 create new chi : 0.32407546043395996 time to delete rle : 0.0003376007080078125 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 1962 TO DO : save crop sub photo not yet done ! save time : 0.17137885093688965 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04648137092590332 time for calcul the mask position with numpy : 0.01584458351135254 nb_pixel_total : 1248630 time to create 1 rle with new method : 0.0794219970703125 time for calcul the mask position with numpy : 0.0065271854400634766 nb_pixel_total : 100267 time to create 1 rle with old method : 0.11205291748046875 time for calcul the mask position with numpy : 0.010772943496704102 nb_pixel_total : 724703 time to create 1 rle with new method : 0.030658721923828125 create new chi : 0.25581955909729004 time to delete rle : 0.0003876686096191406 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3414 TO DO : save crop sub photo not yet done ! save time : 0.27295637130737305 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0500335693359375 time for calcul the mask position with numpy : 0.09638857841491699 nb_pixel_total : 1934267 time to create 1 rle with new method : 0.09766697883605957 time for calcul the mask position with numpy : 0.006768941879272461 nb_pixel_total : 30103 time to create 1 rle with old method : 0.03544116020202637 time for calcul the mask position with numpy : 0.007153511047363281 nb_pixel_total : 109230 time to create 1 rle with old method : 0.12670421600341797 create new chi : 0.37972593307495117 time to delete rle : 0.0005216598510742188 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 2624 TO DO : save crop sub photo not yet done ! save time : 0.213775634765625 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.2783041000366211 time for calcul the mask position with numpy : 0.0920867919921875 nb_pixel_total : 1235373 time to create 1 rle with new method : 0.08329606056213379 time for calcul the mask position with numpy : 0.006753206253051758 nb_pixel_total : 20244 time to create 1 rle with old method : 0.03445100784301758 time for calcul the mask position with numpy : 0.011707782745361328 nb_pixel_total : 807197 time to create 1 rle with new method : 0.2038404941558838 time for calcul the mask position with numpy : 0.006019115447998047 nb_pixel_total : 3520 time to create 1 rle with old method : 0.004047870635986328 time for calcul the mask position with numpy : 0.005922794342041016 nb_pixel_total : 7266 time to create 1 rle with old method : 0.007947683334350586 create new chi : 0.4677596092224121 time to delete rle : 0.0006678104400634766 batch 1 Loaded 9 chid ids of type : 3594 +++++++++Number RLEs to save : 3889 TO DO : save crop sub photo not yet done ! save time : 0.30118894577026367 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04782724380493164 time for calcul the mask position with numpy : 0.01870417594909668 nb_pixel_total : 1957176 time to create 1 rle with new method : 0.18861031532287598 time for calcul the mask position with numpy : 0.0063173770904541016 nb_pixel_total : 105892 time to create 1 rle with old method : 0.11328363418579102 time for calcul the mask position with numpy : 0.005906105041503906 nb_pixel_total : 10532 time to create 1 rle with old method : 0.011468172073364258 create new chi : 0.3519096374511719 time to delete rle : 0.0003807544708251953 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2494 TO DO : save crop sub photo not yet done ! save time : 0.20812439918518066 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.037902116775512695 time for calcul the mask position with numpy : 0.013219833374023438 nb_pixel_total : 1155323 time to create 1 rle with new method : 0.054383277893066406 time for calcul the mask position with numpy : 0.016928434371948242 nb_pixel_total : 918277 time to create 1 rle with new method : 0.14705228805541992 create new chi : 0.23920655250549316 time to delete rle : 0.0003650188446044922 batch 1 Loaded 3 chid ids of type : 3594 +++Number RLEs to save : 4046 TO DO : save crop sub photo not yet done ! save time : 0.3014404773712158 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.21860527992248535 time for calcul the mask position with numpy : 0.010412454605102539 nb_pixel_total : 770875 time to create 1 rle with new method : 0.1392810344696045 time for calcul the mask position with numpy : 0.03648209571838379 nb_pixel_total : 1169848 time to create 1 rle with new method : 0.12827849388122559 time for calcul the mask position with numpy : 0.006162405014038086 nb_pixel_total : 23004 time to create 1 rle with old method : 0.026740550994873047 time for calcul the mask position with numpy : 0.007069110870361328 nb_pixel_total : 109873 time to create 1 rle with old method : 0.12340188026428223 create new chi : 0.49282407760620117 time to delete rle : 0.0009660720825195312 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 6030 TO DO : save crop sub photo not yet done ! save time : 0.4359114170074463 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.13582468032836914 time for calcul the mask position with numpy : 0.13375568389892578 nb_pixel_total : 2030866 time to create 1 rle with new method : 0.09184551239013672 time for calcul the mask position with numpy : 0.010669946670532227 nb_pixel_total : 9586 time to create 1 rle with old method : 0.010782003402709961 time for calcul the mask position with numpy : 0.007748126983642578 nb_pixel_total : 5414 time to create 1 rle with old method : 0.006243228912353516 time for calcul the mask position with numpy : 0.0064449310302734375 nb_pixel_total : 18077 time to create 1 rle with old method : 0.020326614379882812 time for calcul the mask position with numpy : 0.006320953369140625 nb_pixel_total : 9657 time to create 1 rle with old method : 0.011009931564331055 create new chi : 0.3167719841003418 time to delete rle : 0.0004630088806152344 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2098 TO DO : save crop sub photo not yet done ! save time : 0.18779921531677246 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05622267723083496 time for calcul the mask position with numpy : 0.01949906349182129 nb_pixel_total : 2066871 time to create 1 rle with new method : 0.12294268608093262 time for calcul the mask position with numpy : 0.006367206573486328 nb_pixel_total : 6729 time to create 1 rle with old method : 0.008062601089477539 create new chi : 0.15710949897766113 time to delete rle : 0.00023412704467773438 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1318 TO DO : save crop sub photo not yet done ! save time : 0.14024019241333008 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.07346224784851074 time for calcul the mask position with numpy : 0.014950990676879883 nb_pixel_total : 1205293 time to create 1 rle with new method : 0.07805585861206055 time for calcul the mask position with numpy : 0.00660395622253418 nb_pixel_total : 47611 time to create 1 rle with old method : 0.054640769958496094 time for calcul the mask position with numpy : 0.014131784439086914 nb_pixel_total : 727826 time to create 1 rle with new method : 0.13222384452819824 time for calcul the mask position with numpy : 0.006122589111328125 nb_pixel_total : 4478 time to create 1 rle with old method : 0.005441904067993164 time for calcul the mask position with numpy : 0.006412982940673828 nb_pixel_total : 88392 time to create 1 rle with old method : 0.1039273738861084 create new chi : 0.43975210189819336 time to delete rle : 0.0010325908660888672 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4864 TO DO : save crop sub photo not yet done ! save time : 0.352276086807251 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0425877571105957 time for calcul the mask position with numpy : 0.018781661987304688 nb_pixel_total : 2014209 time to create 1 rle with new method : 0.09383416175842285 time for calcul the mask position with numpy : 0.006432294845581055 nb_pixel_total : 55628 time to create 1 rle with old method : 0.06246328353881836 time for calcul the mask position with numpy : 0.0068128108978271484 nb_pixel_total : 3763 time to create 1 rle with old method : 0.0043239593505859375 create new chi : 0.20027470588684082 time to delete rle : 0.00040793418884277344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1752 TO DO : save crop sub photo not yet done ! save time : 0.15476083755493164 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.23519635200500488 time for calcul the mask position with numpy : 0.10955691337585449 nb_pixel_total : 1906216 time to create 1 rle with new method : 0.1833200454711914 time for calcul the mask position with numpy : 0.006716728210449219 nb_pixel_total : 102618 time to create 1 rle with old method : 0.11634325981140137 time for calcul the mask position with numpy : 0.006487131118774414 nb_pixel_total : 43544 time to create 1 rle with old method : 0.048561811447143555 time for calcul the mask position with numpy : 0.006093740463256836 nb_pixel_total : 9252 time to create 1 rle with old method : 0.010358572006225586 time for calcul the mask position with numpy : 0.00616002082824707 nb_pixel_total : 11970 time to create 1 rle with old method : 0.014409542083740234 create new chi : 0.5189070701599121 time to delete rle : 0.0005435943603515625 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 3458 TO DO : save crop sub photo not yet done ! save time : 0.2541189193725586 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04174232482910156 time for calcul the mask position with numpy : 0.03727436065673828 nb_pixel_total : 1193327 time to create 1 rle with new method : 0.2293686866760254 time for calcul the mask position with numpy : 0.007430076599121094 nb_pixel_total : 5658 time to create 1 rle with old method : 0.007191181182861328 time for calcul the mask position with numpy : 0.013957738876342773 nb_pixel_total : 874615 time to create 1 rle with new method : 0.0541384220123291 create new chi : 0.3588106632232666 time to delete rle : 0.0005745887756347656 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 4266 TO DO : save crop sub photo not yet done ! save time : 0.3228147029876709 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.053177595138549805 time for calcul the mask position with numpy : 0.014894485473632812 nb_pixel_total : 1333376 time to create 1 rle with new method : 0.1779344081878662 time for calcul the mask position with numpy : 0.011518478393554688 nb_pixel_total : 732285 time to create 1 rle with new method : 0.1012570858001709 time for calcul the mask position with numpy : 0.0069158077239990234 nb_pixel_total : 4446 time to create 1 rle with old method : 0.005332469940185547 time for calcul the mask position with numpy : 0.010791301727294922 nb_pixel_total : 3493 time to create 1 rle with old method : 0.00418853759765625 create new chi : 0.34298276901245117 time to delete rle : 0.0009288787841796875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3388 TO DO : save crop sub photo not yet done ! save time : 0.2794609069824219 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.07404375076293945 time for calcul the mask position with numpy : 0.013372659683227539 nb_pixel_total : 1092399 time to create 1 rle with new method : 0.16308212280273438 time for calcul the mask position with numpy : 0.006702423095703125 nb_pixel_total : 115380 time to create 1 rle with old method : 0.13251042366027832 time for calcul the mask position with numpy : 0.011483907699584961 nb_pixel_total : 850500 time to create 1 rle with new method : 0.07055521011352539 time for calcul the mask position with numpy : 0.006157636642456055 nb_pixel_total : 15321 time to create 1 rle with old method : 0.018184185028076172 create new chi : 0.4369544982910156 time to delete rle : 0.0008292198181152344 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 5034 TO DO : save crop sub photo not yet done ! save time : 0.39127039909362793 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03492546081542969 time for calcul the mask position with numpy : 0.020209789276123047 nb_pixel_total : 2060440 time to create 1 rle with new method : 0.16840505599975586 time for calcul the mask position with numpy : 0.010568618774414062 nb_pixel_total : 13160 time to create 1 rle with old method : 0.015770673751831055 create new chi : 0.2220747470855713 time to delete rle : 0.00027298927307128906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1382 TO DO : save crop sub photo not yet done ! save time : 0.1354057788848877 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.10350227355957031 time for calcul the mask position with numpy : 0.04011273384094238 nb_pixel_total : 1177563 time to create 1 rle with new method : 0.14656615257263184 time for calcul the mask position with numpy : 0.006618499755859375 nb_pixel_total : 97953 time to create 1 rle with old method : 0.10962510108947754 time for calcul the mask position with numpy : 0.014582633972167969 nb_pixel_total : 768892 time to create 1 rle with new method : 0.16499042510986328 time for calcul the mask position with numpy : 0.011082649230957031 nb_pixel_total : 29192 time to create 1 rle with old method : 0.03320741653442383 create new chi : 0.5367531776428223 time to delete rle : 0.0012819766998291016 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4544 TO DO : save crop sub photo not yet done ! save time : 0.3653533458709717 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06053328514099121 time for calcul the mask position with numpy : 0.027090787887573242 nb_pixel_total : 1957931 time to create 1 rle with new method : 0.09364199638366699 time for calcul the mask position with numpy : 0.007128715515136719 nb_pixel_total : 6093 time to create 1 rle with old method : 0.0071680545806884766 time for calcul the mask position with numpy : 0.007004261016845703 nb_pixel_total : 109576 time to create 1 rle with old method : 0.13766264915466309 create new chi : 0.29073548316955566 time to delete rle : 0.0004928112030029297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2358 TO DO : save crop sub photo not yet done ! save time : 0.2101449966430664 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.11557316780090332 time for calcul the mask position with numpy : 0.04065084457397461 nb_pixel_total : 1230645 time to create 1 rle with new method : 0.16288352012634277 time for calcul the mask position with numpy : 0.006152153015136719 nb_pixel_total : 2671 time to create 1 rle with old method : 0.0032737255096435547 time for calcul the mask position with numpy : 0.007092952728271484 nb_pixel_total : 8529 time to create 1 rle with old method : 0.010851383209228516 time for calcul the mask position with numpy : 0.011745929718017578 nb_pixel_total : 831755 time to create 1 rle with new method : 0.07489681243896484 create new chi : 0.3272130489349365 time to delete rle : 0.0003457069396972656 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3430 TO DO : save crop sub photo not yet done ! save time : 0.2692248821258545 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.048386573791503906 time for calcul the mask position with numpy : 0.13929986953735352 nb_pixel_total : 1967857 time to create 1 rle with new method : 0.13773369789123535 time for calcul the mask position with numpy : 0.01023101806640625 nb_pixel_total : 105743 time to create 1 rle with old method : 0.11755681037902832 create new chi : 0.4154174327850342 time to delete rle : 0.0004563331604003906 batch 1 Loaded 3 chid ids of type : 3594 +++Number RLEs to save : 2218 TO DO : save crop sub photo not yet done ! save time : 0.1894080638885498 map_output_result : {1393152773: (0.0, 'Should be the crop_list due to order', 0), 1393152739: (0.0, 'Should be the crop_list due to order', 0), 1393152672: (0.0, 'Should be the crop_list due to order', 0), 1393152608: (0.0, 'Should be the crop_list due to order', 0), 1393151813: (0.0, 'Should be the crop_list due to order', 0), 1393151776: (0.0, 'Should be the crop_list due to order', 0), 1393151718: (0.0, 'Should be the crop_list due to order', 0), 1393151653: (0.0, 'Should be the crop_list due to order', 0), 1393151601: (0.0, 'Should be the crop_list due to order', 0.0), 1393151567: (0.0, 'Should be the crop_list due to order', 0), 1393151440: (0.0, 'Should be the crop_list due to order', 0), 1393151403: (0.0, 'Should be the crop_list due to order', 0), 1393151361: (0.0, 'Should be the crop_list due to order', 0), 1393151316: (0.0, 'Should be the crop_list due to order', 0), 1393151249: (0.0, 'Should be the crop_list due to order', 0), 1393151170: (0.0, 'Should be the crop_list due to order', 0), 1393150532: (0.0, 'Should be the crop_list due to order', 0), 1393150441: (0.0, 'Should be the crop_list due to order', 0), 1393150353: (0.0, 'Should be the crop_list due to order', 0), 1393150261: (0.0, 'Should be the crop_list due to order', 0), 1393150172: (0.0, 'Should be the crop_list due to order', 0), 1393150113: (0.0, 'Should be the crop_list due to order', 0), 1393149190: (0.0, 'Should be the crop_list due to order', 0), 1393149188: (0.0, 'Should be the crop_list due to order', 0), 1393149169: (0.0, 'Should be the crop_list due to order', 0), 1393149091: (0.0, 'Should be the crop_list due to order', 0), 1393149020: (0.0, 'Should be the crop_list due to order', 0), 1393148974: (0.0, 'Should be the crop_list due to order', 0), 1393148629: (0.0, 'Should be the crop_list due to order', 0), 1393148575: (0.0, 'Should be the crop_list due to order', 0), 1393148503: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1393152773, 1393152739, 1393152672, 1393152608, 1393151813, 1393151776, 1393151718, 1393151653, 1393151601, 1393151567, 1393151440, 1393151403, 1393151361, 1393151316, 1393151249, 1393151170, 1393150532, 1393150441, 1393150353, 1393150261, 1393150172, 1393150113, 1393149190, 1393149188, 1393149169, 1393149091, 1393149020, 1393148974, 1393148629, 1393148575, 1393148503] Looping around the photos to save general results len do output : 31 /1393152773.Didn't retrieve data . /1393152739.Didn't retrieve data . /1393152672.Didn't retrieve data . /1393152608.Didn't retrieve data . /1393151813.Didn't retrieve data . /1393151776.Didn't retrieve data . /1393151718.Didn't retrieve data . /1393151653.Didn't retrieve data . /1393151601.Didn't retrieve data . /1393151567.Didn't retrieve data . /1393151440.Didn't retrieve data . /1393151403.Didn't retrieve data . /1393151361.Didn't retrieve data . /1393151316.Didn't retrieve data . /1393151249.Didn't retrieve data . /1393151170.Didn't retrieve data . /1393150532.Didn't retrieve data . /1393150441.Didn't retrieve data . /1393150353.Didn't retrieve data . /1393150261.Didn't retrieve data . /1393150172.Didn't retrieve data . /1393150113.Didn't retrieve data . /1393149190.Didn't retrieve data . /1393149188.Didn't retrieve data . /1393149169.Didn't retrieve data . /1393149091.Didn't retrieve data . /1393149020.Didn't retrieve data . /1393148974.Didn't retrieve data . /1393148629.Didn't retrieve data . /1393148575.Didn't retrieve data . /1393148503.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152773', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152739', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152672', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152608', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151813', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151776', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151718', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151653', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151601', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151567', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151440', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151403', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151361', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151316', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151249', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151170', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150532', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150441', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150353', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150261', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150172', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150113', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149190', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149188', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149169', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149091', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149020', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148974', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148629', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148575', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148503', None, None, None, None, None, '4018171') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 93 time used for this insertion : 0.02262115478515625 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.58407187461853 time spend to save output : 0.02393054962158203 total time spend for step 3 : 23.608002424240112 step4:ventilate_hashtags_in_portfolio Fri Nov 7 19:23:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28318855 get user id for portfolio 28318855 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28318855 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','background','environnement','metal','pet_fonce','flou','autre','mal_croppe','pet_clair','pehd','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28318855 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','background','environnement','metal','pet_fonce','flou','autre','mal_croppe','pet_clair','pehd','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28318855 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','background','environnement','metal','pet_fonce','flou','autre','mal_croppe','pet_clair','pehd','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28322765,28322766,28322767,28322768,28322769,28322770,28322771,28322772,28322773,28322774,28322775?tags=papier,background,environnement,metal,pet_fonce,flou,autre,mal_croppe,pet_clair,pehd,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1393152773, 1393152739, 1393152672, 1393152608, 1393151813, 1393151776, 1393151718, 1393151653, 1393151601, 1393151567, 1393151440, 1393151403, 1393151361, 1393151316, 1393151249, 1393151170, 1393150532, 1393150441, 1393150353, 1393150261, 1393150172, 1393150113, 1393149190, 1393149188, 1393149169, 1393149091, 1393149020, 1393148974, 1393148629, 1393148575, 1393148503] Looping around the photos to save general results len do output : 1 /28318855. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152773', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152739', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152672', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152608', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151813', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151776', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151718', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151653', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151601', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151567', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151440', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151403', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151361', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151316', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151249', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151170', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150532', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150441', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150353', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150261', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150172', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150113', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149190', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149188', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149169', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149091', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149020', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148974', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148629', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148575', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148503', None, None, None, None, None, '4018171') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 32 time used for this insertion : 0.026897430419921875 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.707714557647705 time spend to save output : 0.02727484703063965 total time spend for step 4 : 1.7349894046783447 step5:final Fri Nov 7 19:23:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1393152773: ('0.23744797889287134',), 1393152739: ('0.23744797889287134',), 1393152672: ('0.23744797889287134',), 1393152608: ('0.23744797889287134',), 1393151813: ('0.23744797889287134',), 1393151776: ('0.23744797889287134',), 1393151718: ('0.23744797889287134',), 1393151653: ('0.23744797889287134',), 1393151601: ('0.23744797889287134',), 1393151567: ('0.23744797889287134',), 1393151440: ('0.23744797889287134',), 1393151403: ('0.23744797889287134',), 1393151361: ('0.23744797889287134',), 1393151316: ('0.23744797889287134',), 1393151249: ('0.23744797889287134',), 1393151170: ('0.23744797889287134',), 1393150532: ('0.23744797889287134',), 1393150441: ('0.23744797889287134',), 1393150353: ('0.23744797889287134',), 1393150261: ('0.23744797889287134',), 1393150172: ('0.23744797889287134',), 1393150113: ('0.23744797889287134',), 1393149190: ('0.23744797889287134',), 1393149188: ('0.23744797889287134',), 1393149169: ('0.23744797889287134',), 1393149091: ('0.23744797889287134',), 1393149020: ('0.23744797889287134',), 1393148974: ('0.23744797889287134',), 1393148629: ('0.23744797889287134',), 1393148575: ('0.23744797889287134',), 1393148503: ('0.23744797889287134',)} new output for save of step final : {1393152773: ('0.23744797889287134',), 1393152739: ('0.23744797889287134',), 1393152672: ('0.23744797889287134',), 1393152608: ('0.23744797889287134',), 1393151813: ('0.23744797889287134',), 1393151776: ('0.23744797889287134',), 1393151718: ('0.23744797889287134',), 1393151653: ('0.23744797889287134',), 1393151601: ('0.23744797889287134',), 1393151567: ('0.23744797889287134',), 1393151440: ('0.23744797889287134',), 1393151403: ('0.23744797889287134',), 1393151361: ('0.23744797889287134',), 1393151316: ('0.23744797889287134',), 1393151249: ('0.23744797889287134',), 1393151170: ('0.23744797889287134',), 1393150532: ('0.23744797889287134',), 1393150441: ('0.23744797889287134',), 1393150353: ('0.23744797889287134',), 1393150261: ('0.23744797889287134',), 1393150172: ('0.23744797889287134',), 1393150113: ('0.23744797889287134',), 1393149190: ('0.23744797889287134',), 1393149188: ('0.23744797889287134',), 1393149169: ('0.23744797889287134',), 1393149091: ('0.23744797889287134',), 1393149020: ('0.23744797889287134',), 1393148974: ('0.23744797889287134',), 1393148629: ('0.23744797889287134',), 1393148575: ('0.23744797889287134',), 1393148503: ('0.23744797889287134',)} [1393152773, 1393152739, 1393152672, 1393152608, 1393151813, 1393151776, 1393151718, 1393151653, 1393151601, 1393151567, 1393151440, 1393151403, 1393151361, 1393151316, 1393151249, 1393151170, 1393150532, 1393150441, 1393150353, 1393150261, 1393150172, 1393150113, 1393149190, 1393149188, 1393149169, 1393149091, 1393149020, 1393148974, 1393148629, 1393148575, 1393148503] Looping around the photos to save general results len do output : 31 /1393152773.Didn't retrieve data . /1393152739.Didn't retrieve data . /1393152672.Didn't retrieve data . /1393152608.Didn't retrieve data . /1393151813.Didn't retrieve data . /1393151776.Didn't retrieve data . /1393151718.Didn't retrieve data . /1393151653.Didn't retrieve data . /1393151601.Didn't retrieve data . /1393151567.Didn't retrieve data . /1393151440.Didn't retrieve data . /1393151403.Didn't retrieve data . /1393151361.Didn't retrieve data . /1393151316.Didn't retrieve data . /1393151249.Didn't retrieve data . /1393151170.Didn't retrieve data . /1393150532.Didn't retrieve data . /1393150441.Didn't retrieve data . /1393150353.Didn't retrieve data . /1393150261.Didn't retrieve data . /1393150172.Didn't retrieve data . /1393150113.Didn't retrieve data . /1393149190.Didn't retrieve data . /1393149188.Didn't retrieve data . /1393149169.Didn't retrieve data . /1393149091.Didn't retrieve data . /1393149020.Didn't retrieve data . /1393148974.Didn't retrieve data . /1393148629.Didn't retrieve data . /1393148575.Didn't retrieve data . /1393148503.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152773', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152739', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152672', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152608', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151813', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151776', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151718', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151653', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151601', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151567', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151440', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151403', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151361', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151316', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151249', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151170', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150532', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150441', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150353', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150261', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150172', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150113', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149190', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149188', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149169', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149091', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149020', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148974', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148629', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148575', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148503', None, None, None, None, None, '4018171') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 93 time used for this insertion : 0.01917409896850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14830636978149414 time spend to save output : 0.020396709442138672 total time spend for step 5 : 0.1687030792236328 step6:blur_detection Fri Nov 7 19:23:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1762539627_378906_1393152773_2523e90b36e426300ab254daa5261fb7.jpg resize: (1080, 1920) 1393152773 -1.5650291688760165 treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3.jpg resize: (1080, 1920) 1393152739 -1.3563848439140695 treat image : temp/1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e.jpg resize: (1080, 1920) 1393152672 -2.0343270814692 treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa.jpg resize: (1080, 1920) 1393152608 -2.826368145026988 treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb.jpg resize: (1080, 1920) 1393151813 -3.957882501566545 treat image : temp/1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab.jpg resize: (1080, 1920) 1393151776 -0.23801321951053395 treat image : temp/1762539627_378906_1393151718_9ef3d840a06610d4c7feab37ae25e6a7.jpg resize: (1080, 1920) 1393151718 -0.9830235690616829 treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23.jpg resize: (1080, 1920) 1393151653 -2.4476809708141722 treat image : temp/1762539627_378906_1393151601_43ab1a68d8558add87ba01b8dd14d72d.jpg resize: (1080, 1920) 1393151601 -2.5352896834685903 treat image : temp/1762539627_378906_1393151567_e08eab10a8cc01195b314d5fe2f8d41d.jpg resize: (1080, 1920) 1393151567 -2.5369615300500654 treat image : temp/1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139.jpg resize: (1080, 1920) 1393151440 -0.9174902172983949 treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e.jpg resize: (1080, 1920) 1393151403 -1.0528976636417406 treat image : temp/1762539627_378906_1393151361_b3202685b7f47097c8895437b567c8ff.jpg resize: (1080, 1920) 1393151361 -2.0023782597493547 treat image : temp/1762539627_378906_1393151316_37c2ad77407d3449de55d303d5acd3b9.jpg resize: (1080, 1920) 1393151316 -0.31545084039750043 treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee.jpg resize: (1080, 1920) 1393151249 -0.7192790081294732 treat image : temp/1762539627_378906_1393151170_e01ce14f2e8eb9fba4ac1ec210c6e2cd.jpg resize: (1080, 1920) 1393151170 -2.1014351715567625 treat image : temp/1762539627_378906_1393150532_8a3d501896d7638f257f4740bf780238.jpg resize: (1080, 1920) 1393150532 -1.8251279687688124 treat image : temp/1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2.jpg resize: (1080, 1920) 1393150441 -2.303202740452634 treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b.jpg resize: (1080, 1920) 1393150353 -2.5332219457433034 treat image : temp/1762539627_378906_1393150261_ac3ff0cbe4c30d6fd6eaa9dd669bc45c.jpg resize: (1080, 1920) 1393150261 -1.9136291536567762 treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe.jpg resize: (1080, 1920) 1393150172 -1.2358375827677572 treat image : temp/1762539627_378906_1393150113_259142655aaf8b6feeeed49d9ed00060.jpg resize: (1080, 1920) 1393150113 -1.7492709716173522 treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602.jpg resize: (1080, 1920) 1393149190 -2.3132592893703663 treat image : temp/1762539627_378906_1393149188_bbe26a01e9d0ced6749c4d421954362f.jpg resize: (1080, 1920) 1393149188 -1.4266860290686536 treat image : temp/1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89.jpg resize: (1080, 1920) 1393149169 -2.1093000990723207 treat image : temp/1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a.jpg resize: (1080, 1920) 1393149091 -4.430363073978587 treat image : temp/1762539627_378906_1393149020_73febe18ddb4819ead10ed0843e2f5cb.jpg resize: (1080, 1920) 1393149020 -1.5239396562525451 treat image : temp/1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a.jpg resize: (1080, 1920) 1393148974 -0.9385809745262106 treat image : temp/1762539627_378906_1393148629_bb6d947878e785a2dec733189768bac0.jpg resize: (1080, 1920) 1393148629 -2.251062455497342 treat image : temp/1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a.jpg resize: (1080, 1920) 1393148575 -1.2331519162731297 treat image : temp/1762539627_378906_1393148503_10b86e63c03f48e13d90d1befdbe6223.jpg resize: (1080, 1920) 1393148503 -1.3120142267835473 treat image : temp/1762539627_378906_1393152773_2523e90b36e426300ab254daa5261fb7_rle_crop_4025582958_0.png resize: (202, 99) 1393205556 -2.5607220084394204 treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582970_0.png resize: (114, 84) 1393205557 -1.4516629739582905 treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582971_0.png resize: (58, 113) 1393205560 -3.008257955287259 treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582972_0.png resize: (129, 93) 1393205561 -1.1680043206090394 treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582975_0.png resize: (105, 44) 1393205562 -2.9967619929223575 treat image : temp/1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582977_0.png resize: (110, 89) 1393205565 -0.7547359652355424 treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582983_0.png resize: (122, 94) 1393205566 -2.0008818156440666 treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582990_0.png resize: (47, 38) 1393205567 0.12895596317431518 treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582991_0.png resize: (131, 157) 1393205570 -1.4006119994832134 treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582992_0.png resize: (118, 100) 1393205571 -1.4991135375269367 treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025582998_0.png resize: (113, 145) 1393205572 -2.4917694922607416 treat image : temp/1762539627_378906_1393151170_e01ce14f2e8eb9fba4ac1ec210c6e2cd_rle_crop_4025583002_0.png resize: (154, 139) 1393205575 -2.2526557606379227 treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583010_0.png resize: (124, 62) 1393205576 -1.4191380263365274 treat image : temp/1762539627_378906_1393150261_ac3ff0cbe4c30d6fd6eaa9dd669bc45c_rle_crop_4025583012_0.png resize: (119, 85) 1393205577 -1.5114509454279264 treat image : temp/1762539627_378906_1393149188_bbe26a01e9d0ced6749c4d421954362f_rle_crop_4025583024_0.png resize: (108, 79) 1393205580 -1.626837721745723 treat image : temp/1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583026_0.png resize: (99, 99) 1393205581 -2.57143774928404 treat image : temp/1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583038_0.png resize: (103, 133) 1393205582 -1.8737444642822996 treat image : temp/1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583039_0.png resize: (46, 81) 1393205585 0.6151204170917863 treat image : temp/1762539627_378906_1393152773_2523e90b36e426300ab254daa5261fb7_rle_crop_4025582959_0.png resize: (126, 124) 1393205667 -1.2895417659152189 treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582969_0.png resize: (160, 122) 1393205669 -1.407604372752584 treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582976_0.png resize: (160, 117) 1393205671 -1.090957219269644 treat image : temp/1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582979_0.png resize: (526, 336) 1393205673 0.0748093225831284 treat image : temp/1762539627_378906_1393151718_9ef3d840a06610d4c7feab37ae25e6a7_rle_crop_4025582980_0.png resize: (110, 78) 1393205675 -0.5659297767774892 treat image : temp/1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583005_0.png resize: (536, 335) 1393205677 -0.5151055992206276 treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583008_0.png resize: (134, 115) 1393205679 -2.0100971217502237 treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583011_0.png resize: (122, 101) 1393205681 -0.026980824153290152 treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583022_0.png resize: (536, 357) 1393205683 -0.7754074479927852 treat image : temp/1762539627_378906_1393148629_bb6d947878e785a2dec733189768bac0_rle_crop_4025583036_0.png resize: (111, 75) 1393205685 -0.6360275333205289 treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582960_0.png resize: (142, 80) 1393206094 0.054942578694793374 treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582961_0.png resize: (154, 282) 1393206095 -1.9704663266316904 treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582962_0.png resize: (255, 127) 1393206096 -2.7732116400601363 treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582963_0.png resize: (929, 1090) 1393206097 0.8759300937710893 treat image : temp/1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582964_0.png resize: (368, 710) 1393206098 -4.170842074934488 treat image : temp/1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582965_0.png resize: (876, 1022) 1393206099 -0.40138547639518235 treat image : temp/1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582966_0.png resize: (523, 309) 1393206100 -0.2109128608552439 treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582967_0.png resize: (470, 324) 1393206102 -0.25369378071606724 treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582968_0.png resize: (117, 147) 1393206103 -1.9664562032595518 treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582974_0.png resize: (551, 341) 1393206104 0.050903264327451646 treat image : temp/1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582978_0.png resize: (530, 337) 1393206105 0.29484736581757115 treat image : temp/1762539627_378906_1393151718_9ef3d840a06610d4c7feab37ae25e6a7_rle_crop_4025582981_0.png resize: (989, 1202) 1393206106 0.053938873038946525 treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582982_0.png resize: (95, 127) 1393206107 -3.162851827962985 treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582984_0.png resize: (509, 384) 1393206108 0.266613086638899 treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582985_0.png resize: (919, 1548) 1393206109 -1.7150709327881455 treat image : temp/1762539627_378906_1393151567_e08eab10a8cc01195b314d5fe2f8d41d_rle_crop_4025582986_0.png resize: (48, 113) 1393206110 -1.7666280334287323 treat image : temp/1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582987_0.png resize: (88, 173) 1393206111 -3.2583179318800832 treat image : temp/1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582988_0.png resize: (478, 356) 1393206112 0.5481283470542301 treat image : temp/1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582989_0.png resize: (1005, 1155) 1393206113 -0.6499660745192379 treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582993_0.png resize: (105, 75) 1393206114 -3.37694111028214 treat image : temp/1762539627_378906_1393151361_b3202685b7f47097c8895437b567c8ff_rle_crop_4025582994_0.png resize: (923, 977) 1393206115 1.1653330686532009 treat image : temp/1762539627_378906_1393151361_b3202685b7f47097c8895437b567c8ff_rle_crop_4025582995_0.png resize: (239, 578) 1393206116 -3.0953583953883284 treat image : temp/1762539627_378906_1393151316_37c2ad77407d3449de55d303d5acd3b9_rle_crop_4025582996_0.png resize: (503, 344) 1393206117 0.4748166695856113 treat image : temp/1762539627_378906_1393151316_37c2ad77407d3449de55d303d5acd3b9_rle_crop_4025582997_0.png resize: (267, 182) 1393206118 -1.3371260093109887 treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025583000_0.png resize: (965, 1189) 1393206119 0.8291074218474207 treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025583001_0.png resize: (152, 196) 1393206120 -3.0978728474052586 treat image : temp/1762539627_378906_1393151170_e01ce14f2e8eb9fba4ac1ec210c6e2cd_rle_crop_4025583003_0.png resize: (525, 340) 1393206121 0.37562151594655213 treat image : temp/1762539627_378906_1393150532_8a3d501896d7638f257f4740bf780238_rle_crop_4025583004_0.png resize: (1000, 1299) 1393206122 -0.8779599919281611 treat image : temp/1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583006_0.png resize: (255, 148) 1393206123 -2.0419739377358783 treat image : temp/1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583007_0.png resize: (991, 1342) 1393206124 -2.5170403287345255 treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583009_0.png resize: (120, 230) 1393206125 -3.752772937686517 treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583013_0.png resize: (484, 338) 1393206126 -0.44990454221060755 treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583014_0.png resize: (87, 67) 1393206127 -3.362057959500466 treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583015_0.png resize: (993, 1005) 1393206128 0.164897835654896 treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583016_0.png resize: (313, 203) 1393206129 -0.32704274596119487 treat image : temp/1762539627_378906_1393150113_259142655aaf8b6feeeed49d9ed00060_rle_crop_4025583017_0.png resize: (56, 80) 1393206130 -2.313120475234528 treat image : temp/1762539627_378906_1393150113_259142655aaf8b6feeeed49d9ed00060_rle_crop_4025583018_0.png resize: (277, 284) 1393206131 -0.6777498447052571 treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583019_0.png resize: (107, 183) 1393206132 -2.0496192309996544 treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583020_0.png resize: (137, 95) 1393206133 -2.2986883097631394 treat image : temp/1762539627_378906_1393149188_bbe26a01e9d0ced6749c4d421954362f_rle_crop_4025583023_0.png resize: (987, 1175) 1393206134 -1.181526928039411 treat image : temp/1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583025_0.png resize: (74, 60) 1393206135 -3.578345038822366 treat image : temp/1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583027_0.png resize: (975, 978) 1393206136 -0.16948430085226915 treat image : temp/1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583028_0.png resize: (221, 166) 1393206137 -2.895412953638865 treat image : temp/1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583029_0.png resize: (785, 1366) 1393206138 -4.9054818795797095 treat image : temp/1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583030_0.png resize: (543, 347) 1393206139 0.055012629421224174 treat image : temp/1762539627_378906_1393149020_73febe18ddb4819ead10ed0843e2f5cb_rle_crop_4025583031_0.png resize: (151, 116) 1393206140 -4.738202033441126 treat image : temp/1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583032_0.png resize: (231, 181) 1393206141 -2.5757890247957342 treat image : temp/1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583033_0.png resize: (992, 1077) 1393206142 0.05940428539134016 treat image : temp/1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583034_0.png resize: (476, 314) 1393206143 -0.023681818360640847 treat image : temp/1762539627_378906_1393148629_bb6d947878e785a2dec733189768bac0_rle_crop_4025583035_0.png resize: (525, 350) 1393206144 0.06993544303316229 treat image : temp/1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583037_0.png resize: (996, 1177) 1393206145 0.4597865908096406 treat image : temp/1762539627_378906_1393148503_10b86e63c03f48e13d90d1befdbe6223_rle_crop_4025583040_0.png resize: (536, 346) 1393206146 -0.2663530829596963 treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582973_0.png resize: (102, 97) 1393206150 -2.9208038591749315 treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025582999_0.png resize: (131, 40) 1393206151 -1.4029877186108901 treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583021_0.png resize: (326, 156) 1393206152 0.7966630672240241 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 114 time used for this insertion : 0.01654362678527832 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 114 time used for this insertion : 0.029786109924316406 save missing photos in datou_result : time spend for datou_step_exec : 33.325003147125244 time spend to save output : 0.051969051361083984 total time spend for step 6 : 33.37697219848633 step7:brightness Fri Nov 7 19:23:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1762539627_378906_1393152773_2523e90b36e426300ab254daa5261fb7.jpg treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3.jpg treat image : temp/1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e.jpg treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa.jpg treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb.jpg treat image : temp/1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab.jpg treat image : temp/1762539627_378906_1393151718_9ef3d840a06610d4c7feab37ae25e6a7.jpg treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23.jpg treat image : temp/1762539627_378906_1393151601_43ab1a68d8558add87ba01b8dd14d72d.jpg treat image : temp/1762539627_378906_1393151567_e08eab10a8cc01195b314d5fe2f8d41d.jpg treat image : temp/1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139.jpg treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e.jpg treat image : temp/1762539627_378906_1393151361_b3202685b7f47097c8895437b567c8ff.jpg treat image : temp/1762539627_378906_1393151316_37c2ad77407d3449de55d303d5acd3b9.jpg treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee.jpg treat image : temp/1762539627_378906_1393151170_e01ce14f2e8eb9fba4ac1ec210c6e2cd.jpg treat image : temp/1762539627_378906_1393150532_8a3d501896d7638f257f4740bf780238.jpg treat image : temp/1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2.jpg treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b.jpg treat image : temp/1762539627_378906_1393150261_ac3ff0cbe4c30d6fd6eaa9dd669bc45c.jpg treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe.jpg treat image : temp/1762539627_378906_1393150113_259142655aaf8b6feeeed49d9ed00060.jpg treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602.jpg treat image : temp/1762539627_378906_1393149188_bbe26a01e9d0ced6749c4d421954362f.jpg treat image : temp/1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89.jpg treat image : temp/1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a.jpg treat image : temp/1762539627_378906_1393149020_73febe18ddb4819ead10ed0843e2f5cb.jpg treat image : temp/1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a.jpg treat image : temp/1762539627_378906_1393148629_bb6d947878e785a2dec733189768bac0.jpg treat image : temp/1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a.jpg treat image : temp/1762539627_378906_1393148503_10b86e63c03f48e13d90d1befdbe6223.jpg treat image : temp/1762539627_378906_1393152773_2523e90b36e426300ab254daa5261fb7_rle_crop_4025582958_0.png treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582970_0.png treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582971_0.png treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582972_0.png treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582975_0.png treat image : temp/1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582977_0.png treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582983_0.png treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582990_0.png treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582991_0.png treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582992_0.png treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025582998_0.png treat image : temp/1762539627_378906_1393151170_e01ce14f2e8eb9fba4ac1ec210c6e2cd_rle_crop_4025583002_0.png treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583010_0.png treat image : temp/1762539627_378906_1393150261_ac3ff0cbe4c30d6fd6eaa9dd669bc45c_rle_crop_4025583012_0.png treat image : temp/1762539627_378906_1393149188_bbe26a01e9d0ced6749c4d421954362f_rle_crop_4025583024_0.png treat image : temp/1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583026_0.png treat image : temp/1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583038_0.png treat image : temp/1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583039_0.png treat image : temp/1762539627_378906_1393152773_2523e90b36e426300ab254daa5261fb7_rle_crop_4025582959_0.png treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582969_0.png treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582976_0.png treat image : temp/1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582979_0.png treat image : temp/1762539627_378906_1393151718_9ef3d840a06610d4c7feab37ae25e6a7_rle_crop_4025582980_0.png treat image : temp/1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583005_0.png treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583008_0.png treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583011_0.png treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583022_0.png treat image : temp/1762539627_378906_1393148629_bb6d947878e785a2dec733189768bac0_rle_crop_4025583036_0.png treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582960_0.png treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582961_0.png treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582962_0.png treat image : temp/1762539627_378906_1393152739_ffa035534ac1a0042f83e4e5a8be70c3_rle_crop_4025582963_0.png treat image : temp/1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582964_0.png treat image : temp/1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582965_0.png treat image : temp/1762539627_378906_1393152672_b5ddcc017456b525835ba57b3c6fb58e_rle_crop_4025582966_0.png treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582967_0.png treat image : temp/1762539627_378906_1393152608_c9c46f7d4086ba14ea0606994a67efaa_rle_crop_4025582968_0.png treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582974_0.png treat image : temp/1762539627_378906_1393151776_324231c076272c6be56dc33ac546f5ab_rle_crop_4025582978_0.png treat image : temp/1762539627_378906_1393151718_9ef3d840a06610d4c7feab37ae25e6a7_rle_crop_4025582981_0.png treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582982_0.png treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582984_0.png treat image : temp/1762539627_378906_1393151653_af53c89deb832448ac7f1bcbab533d23_rle_crop_4025582985_0.png treat image : temp/1762539627_378906_1393151567_e08eab10a8cc01195b314d5fe2f8d41d_rle_crop_4025582986_0.png treat image : temp/1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582987_0.png treat image : temp/1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582988_0.png treat image : temp/1762539627_378906_1393151440_47ae38ccdf4d1c9b6c95f2136f4f5139_rle_crop_4025582989_0.png treat image : temp/1762539627_378906_1393151403_af6fee523714ee52bfefe261a6e9ba0e_rle_crop_4025582993_0.png treat image : temp/1762539627_378906_1393151361_b3202685b7f47097c8895437b567c8ff_rle_crop_4025582994_0.png treat image : temp/1762539627_378906_1393151361_b3202685b7f47097c8895437b567c8ff_rle_crop_4025582995_0.png treat image : temp/1762539627_378906_1393151316_37c2ad77407d3449de55d303d5acd3b9_rle_crop_4025582996_0.png treat image : temp/1762539627_378906_1393151316_37c2ad77407d3449de55d303d5acd3b9_rle_crop_4025582997_0.png treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025583000_0.png treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025583001_0.png treat image : temp/1762539627_378906_1393151170_e01ce14f2e8eb9fba4ac1ec210c6e2cd_rle_crop_4025583003_0.png treat image : temp/1762539627_378906_1393150532_8a3d501896d7638f257f4740bf780238_rle_crop_4025583004_0.png treat image : temp/1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583006_0.png treat image : temp/1762539627_378906_1393150441_44bf852edab807c52bee90e7647e90a2_rle_crop_4025583007_0.png treat image : temp/1762539627_378906_1393150353_8aa940f50befd5dbe00a2a7f6f72e19b_rle_crop_4025583009_0.png treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583013_0.png treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583014_0.png treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583015_0.png treat image : temp/1762539627_378906_1393150172_f528236ef354d461a785d15a694f3efe_rle_crop_4025583016_0.png treat image : temp/1762539627_378906_1393150113_259142655aaf8b6feeeed49d9ed00060_rle_crop_4025583017_0.png treat image : temp/1762539627_378906_1393150113_259142655aaf8b6feeeed49d9ed00060_rle_crop_4025583018_0.png treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583019_0.png treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583020_0.png treat image : temp/1762539627_378906_1393149188_bbe26a01e9d0ced6749c4d421954362f_rle_crop_4025583023_0.png treat image : temp/1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583025_0.png treat image : temp/1762539627_378906_1393149169_d6fc3867d553a49fef573138d89b3a89_rle_crop_4025583027_0.png treat image : temp/1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583028_0.png treat image : temp/1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583029_0.png treat image : temp/1762539627_378906_1393149091_08614bb58fceeb8d45aa7ec62e56dc1a_rle_crop_4025583030_0.png treat image : temp/1762539627_378906_1393149020_73febe18ddb4819ead10ed0843e2f5cb_rle_crop_4025583031_0.png treat image : temp/1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583032_0.png treat image : temp/1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583033_0.png treat image : temp/1762539627_378906_1393148974_3670e980e47205af42f723f0740a654a_rle_crop_4025583034_0.png treat image : temp/1762539627_378906_1393148629_bb6d947878e785a2dec733189768bac0_rle_crop_4025583035_0.png treat image : temp/1762539627_378906_1393148575_b95f3c51b2b2956a743daa8a0c66d99a_rle_crop_4025583037_0.png treat image : temp/1762539627_378906_1393148503_10b86e63c03f48e13d90d1befdbe6223_rle_crop_4025583040_0.png treat image : temp/1762539627_378906_1393151813_801d5391bf0116d7958ddb0ae018c4fb_rle_crop_4025582973_0.png treat image : temp/1762539627_378906_1393151249_3ae7c2924ae15e53fd3d5137b9a5b8ee_rle_crop_4025582999_0.png treat image : temp/1762539627_378906_1393149190_85d5f2599abd9375dfe659bd2b3e1602_rle_crop_4025583021_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 114 time used for this insertion : 0.021488428115844727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 114 time used for this insertion : 0.03525090217590332 save missing photos in datou_result : time spend for datou_step_exec : 9.346026182174683 time spend to save output : 0.06201028823852539 total time spend for step 7 : 9.408036470413208 step8:velours_tree Fri Nov 7 19:23:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08379173278808594 time spend to save output : 3.600120544433594e-05 total time spend for step 8 : 0.08382773399353027 step9:send_mail_cod Fri Nov 7 19:23:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28318855_07-11-2025_19_23_58.pdf 28322765 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283227651762539838 28322766 imagette283227661762539840 28322768 imagette283227681762539840 28322769 imagette283227691762539840 28322770 imagette283227701762539840 28322771 change filename to text .change filename to text .change filename to text .imagette283227711762539840 28322772 imagette283227721762539840 28322773 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283227731762539840 28322774 imagette283227741762539842 28322775 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283227751762539842 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28318855 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28322765,28322766,28322767,28322768,28322769,28322770,28322771,28322772,28322773,28322774,28322775?tags=papier,background,environnement,metal,pet_fonce,flou,autre,mal_croppe,pet_clair,pehd,carton args[1393152773] : ((1393152773, -1.5650291688760165, 492688767), (1393152773, 0.4863356638450099, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393152739] : ((1393152739, -1.3563848439140695, 492688767), (1393152739, 0.628203443475491, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393152672] : ((1393152672, -2.0343270814692, 492609224), (1393152672, 0.413396204345013, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393152608] : ((1393152608, -2.826368145026988, 492609224), (1393152608, 0.36375446394191685, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151813] : ((1393151813, -3.957882501566545, 492609224), (1393151813, 0.4230555409988236, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151776] : ((1393151776, -0.23801321951053395, 492688767), (1393151776, 0.44343728238408014, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151718] : ((1393151718, -0.9830235690616829, 492688767), (1393151718, 0.4030695130006684, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151653] : ((1393151653, -2.4476809708141722, 492609224), (1393151653, 0.43406227732673935, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151601] : ((1393151601, -2.5352896834685903, 492609224), (1393151601, 0.43291712057483495, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151567] : ((1393151567, -2.5369615300500654, 492609224), (1393151567, 0.5186959484719589, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151440] : ((1393151440, -0.9174902172983949, 492688767), (1393151440, 0.7510086259722802, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151403] : ((1393151403, -1.0528976636417406, 492688767), (1393151403, 0.4399504103061628, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151361] : ((1393151361, -2.0023782597493547, 492609224), (1393151361, 0.5393626833434871, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151316] : ((1393151316, -0.31545084039750043, 492688767), (1393151316, 0.46806238535524314, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151249] : ((1393151249, -0.7192790081294732, 492688767), (1393151249, 0.3282020129155517, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393151170] : ((1393151170, -2.1014351715567625, 492609224), (1393151170, 0.48304038846846203, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393150532] : ((1393150532, -1.8251279687688124, 492688767), (1393150532, 0.4440056194026482, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393150441] : ((1393150441, -2.303202740452634, 492609224), (1393150441, 0.5606944650933802, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393150353] : ((1393150353, -2.5332219457433034, 492609224), (1393150353, 0.4629065198275282, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393150261] : ((1393150261, -1.9136291536567762, 492688767), (1393150261, 0.5216589322449101, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393150172] : ((1393150172, -1.2358375827677572, 492688767), (1393150172, 0.6742015307779363, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393150113] : ((1393150113, -1.7492709716173522, 492688767), (1393150113, 0.7161202961850818, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393149190] : ((1393149190, -2.3132592893703663, 492609224), (1393149190, 0.44819500824086245, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393149188] : ((1393149188, -1.4266860290686536, 492688767), (1393149188, 0.4802706295149387, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393149169] : ((1393149169, -2.1093000990723207, 492609224), (1393149169, 0.674546082817737, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393149091] : ((1393149091, -4.430363073978587, 492609224), (1393149091, 0.43365801662129355, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393149020] : ((1393149020, -1.5239396562525451, 492688767), (1393149020, 0.7793897467609026, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393148974] : ((1393148974, -0.9385809745262106, 492688767), (1393148974, 0.5724766511662739, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393148629] : ((1393148629, -2.251062455497342, 492609224), (1393148629, 0.6144761744874306, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393148575] : ((1393148575, -1.2331519162731297, 492688767), (1393148575, 0.5603072604008374, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com args[1393148503] : ((1393148503, -1.3120142267835473, 492688767), (1393148503, 0.4454683713770466, 2107752395), '0.23744797889287134') We are sending mail with results at report@fotonower.com refus_total : 0.23744797889287134 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28318855 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28318855_07-11-2025_19_23_58.pdf results_Auto_P28318855_07-11-2025_19_23_58.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28318855_07-11-2025_19_23_58.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28318855','results_Auto_P28318855_07-11-2025_19_23_58.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28318855_07-11-2025_19_23_58.pdf','pdf','','0.84','0.23744797889287134') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28318855

https://www.fotonower.com/image?json=false&list_photos_id=1393152773
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393152739
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393152672
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393152608
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151813
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151776
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151718
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151653
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151601
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151567
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151440
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151403
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151361
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151316
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151249
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393151170
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393150532
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393150441
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393150353
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393150261
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393150172
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393150113
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393149190
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393149188
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393149169
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393149091
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393149020
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393148974
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393148629
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393148575
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393148503
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 23.74%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28322765?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28322771?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28322773?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28322775?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28318855_07-11-2025_19_23_58.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28322765,28322766,28322767,28322768,28322769,28322770,28322771,28322772,28322773,28322774,28322775?tags=papier,background,environnement,metal,pet_fonce,flou,autre,mal_croppe,pet_clair,pehd,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 07 Nov 2025 18:24:05 GMT Content-Length: 0 Connection: close X-Message-Id: FO24WGJFTmuR1tj7Vf2SbA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1393152773, 1393152739, 1393152672, 1393152608, 1393151813, 1393151776, 1393151718, 1393151653, 1393151601, 1393151567, 1393151440, 1393151403, 1393151361, 1393151316, 1393151249, 1393151170, 1393150532, 1393150441, 1393150353, 1393150261, 1393150172, 1393150113, 1393149190, 1393149188, 1393149169, 1393149091, 1393149020, 1393148974, 1393148629, 1393148575, 1393148503] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152773', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152739', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152672', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152608', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151813', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151776', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151718', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151653', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151601', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151567', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151440', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151403', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151361', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151316', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151249', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151170', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150532', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150441', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150353', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150261', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150172', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150113', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149190', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149188', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149169', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149091', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149020', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148974', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148629', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148575', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148503', None, None, None, None, None, '4018171') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 31 time used for this insertion : 0.018314123153686523 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.085348606109619 time spend to save output : 0.01870250701904297 total time spend for step 9 : 7.104051113128662 step10:split_time_score Fri Nov 7 19:24:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 31),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07112025 28318855 Nombre de photos uploadées : 31 / 23040 (0%) 07112025 28318855 Nombre de photos taguées (types de déchets): 0 / 31 (0%) 07112025 28318855 Nombre de photos taguées (volume) : 0 / 31 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ??????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0013799667358398438 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20417189598083496 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.004566883144718793 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28298577_07-11-2025_09_51_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28298577 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28298577 AND mptpi.`type`=3594 To do Qualite : 0.01407957175925926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28298579_07-11-2025_09_41_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28298579 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28298579 AND mptpi.`type`=3594 To do Qualite : 0.03971610363618827 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28298580_07-11-2025_09_31_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28298580 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28298580 AND mptpi.`type`=3594 To do Qualite : 0.03227211686847103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28304078_07-11-2025_12_12_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28304078 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28304078 AND mptpi.`type`=3594 To do Qualite : 0.08912945898622983 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317462_07-11-2025_19_01_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317462 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317462 AND mptpi.`type`=3594 To do Qualite : 0.1594647526577503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317465_07-11-2025_18_51_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317465 AND mptpi.`type`=3594 To do Qualite : 0.11926633230452677 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317467_07-11-2025_18_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317467 AND mptpi.`type`=3594 To do Qualite : 0.24889986014660495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317509_07-11-2025_18_31_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317509 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317509 AND mptpi.`type`=3594 To do Qualite : 0.07542040412808643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317536_07-11-2025_18_01_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317536 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317536 AND mptpi.`type`=3594 To do Qualite : 0.10745382426697532 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317550_07-11-2025_17_51_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317550 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317550 AND mptpi.`type`=3594 To do Qualite : 0.17492326817558299 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28318849_07-11-2025_18_22_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28318849 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28318849 AND mptpi.`type`=3594 To do Qualite : 0.23744797889287134 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28318855_07-11-2025_19_23_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28318855 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28318855 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07112025': {'nb_upload': 31, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1393152773, 1393152739, 1393152672, 1393152608, 1393151813, 1393151776, 1393151718, 1393151653, 1393151601, 1393151567, 1393151440, 1393151403, 1393151361, 1393151316, 1393151249, 1393151170, 1393150532, 1393150441, 1393150353, 1393150261, 1393150172, 1393150113, 1393149190, 1393149188, 1393149169, 1393149091, 1393149020, 1393148974, 1393148629, 1393148575, 1393148503] Looping around the photos to save general results len do output : 1 /28318855Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152773', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152739', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152672', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393152608', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151813', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151776', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151718', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151653', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151601', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151567', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151440', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151403', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151361', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151316', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151249', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393151170', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150532', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150441', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150353', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150261', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150172', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393150113', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149190', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149188', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149169', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149091', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393149020', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148974', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148629', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148575', None, None, None, None, None, '4018171') ('3318', None, None, None, None, None, None, None, '4018171') ('3318', '28318855', '1393148503', None, None, None, None, None, '4018171') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 32 time used for this insertion : 0.01729440689086914 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1042797565460205 time spend to save output : 0.017615318298339844 total time spend for step 10 : 1.1218950748443604 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 31 set_done_treatment 146.05user 39.32system 3:42.89elapsed 83%CPU (0avgtext+0avgdata 3170924maxresident)k 789520inputs+92912outputs (3214major+3192223minor)pagefaults 0swaps