python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 618340 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4328362'] with mtr_portfolio_ids : ['30080405'] and first list_photo_ids : [] new path : /proc/618340/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.3626043796539307 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Jan 10 19:40:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10826 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-10 19:40:35.310409: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-10 19:40:35.342417: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-10 19:40:35.344422: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9ca4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-10 19:40:35.344476: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-10 19:40:35.348039: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-10 19:40:35.574987: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x30ab6a70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-10 19:40:35.575022: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-10 19:40:35.576026: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-10 19:40:35.576306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-10 19:40:35.578446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-10 19:40:35.594587: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-10 19:40:35.594963: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-10 19:40:35.621047: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-10 19:40:35.624118: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-10 19:40:35.654473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-10 19:40:35.655930: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-10 19:40:35.656254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-10 19:40:35.656980: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-10 19:40:35.656995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-10 19:40:35.657003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-10 19:40:35.658283: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-10 19:40:35.955315: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-10 19:40:35.955441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-10 19:40:35.955479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-10 19:40:35.955516: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-10 19:40:35.955549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-10 19:40:35.955584: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-10 19:40:35.955617: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-10 19:40:35.955650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-10 19:40:35.957940: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-10 19:40:35.960005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-10 19:40:35.960054: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-10 19:40:35.960080: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-10 19:40:35.960104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-10 19:40:35.960127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-10 19:40:35.960151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-10 19:40:35.960175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-10 19:40:35.960198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-10 19:40:35.962334: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-10 19:40:35.962395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-10 19:40:35.962410: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-10 19:40:35.962423: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-10 19:40:35.964119: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-10 19:40:45.555712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-10 19:40:45.733968: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 Detection mask done ! Trying to reset tf kernel 618970 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5537 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10826 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [528, 564, 744, 762] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 27992 time to create 1 rle with old method : 0.029752016067504883 length of segment : 205 DEBUG bbox = [1476, 438, 2040, 924] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0035200119018554688 nb_pixel_total : 187494 time to create 1 rle with new method : 0.008275985717773438 length of segment : 580 DEBUG bbox = [1578, 2028, 1854, 2370] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008351802825927734 nb_pixel_total : 60621 time to create 1 rle with old method : 0.062151432037353516 length of segment : 266 DEBUG bbox = [486, 450, 1272, 1356] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.015868186950683594 nb_pixel_total : 381780 time to create 1 rle with new method : 0.032620906829833984 length of segment : 893 DEBUG bbox = [1110, 2682, 1500, 2994] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009868144989013672 nb_pixel_total : 62681 time to create 1 rle with old method : 0.06414651870727539 length of segment : 486 DEBUG bbox = [324, 1134, 1008, 1980] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004446506500244141 nb_pixel_total : 342847 time to create 1 rle with new method : 0.023887157440185547 length of segment : 593 DEBUG bbox = [1860, 1848, 2160, 2376] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015366077423095703 nb_pixel_total : 106202 time to create 1 rle with old method : 0.11202335357666016 length of segment : 278 DEBUG bbox = [1878, 882, 2142, 1116] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006613731384277344 nb_pixel_total : 51582 time to create 1 rle with old method : 0.054898977279663086 length of segment : 262 DEBUG bbox = [132, 618, 312, 846] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004534721374511719 nb_pixel_total : 18360 time to create 1 rle with old method : 0.019387245178222656 length of segment : 155 DEBUG bbox = [1122, 2454, 1368, 2796] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006384849548339844 nb_pixel_total : 38846 time to create 1 rle with old method : 0.0401763916015625 length of segment : 202 DEBUG bbox = [1752, 1122, 2142, 1620] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021882057189941406 nb_pixel_total : 154270 time to create 1 rle with new method : 0.005167722702026367 length of segment : 388 DEBUG bbox = [1572, 426, 1848, 576] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004150867462158203 nb_pixel_total : 23331 time to create 1 rle with old method : 0.024155616760253906 length of segment : 272 DEBUG bbox = [192, 1164, 438, 1470] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006227493286132812 nb_pixel_total : 39346 time to create 1 rle with old method : 0.04247713088989258 length of segment : 250 DEBUG bbox = [546, 1458, 780, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006918907165527344 nb_pixel_total : 46068 time to create 1 rle with old method : 0.05032658576965332 length of segment : 206 DEBUG bbox = [1326, 468, 1782, 726] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001043081283569336 nb_pixel_total : 74178 time to create 1 rle with old method : 0.08081936836242676 length of segment : 428 DEBUG bbox = [2052, 2580, 2148, 2688] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001552104949951172 nb_pixel_total : 8430 time to create 1 rle with old method : 0.009172916412353516 length of segment : 91 DEBUG bbox = [240, 1278, 456, 1680] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007309913635253906 nb_pixel_total : 42784 time to create 1 rle with old method : 0.046439170837402344 length of segment : 213 DEBUG bbox = [1836, 1920, 2142, 2652] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001790761947631836 nb_pixel_total : 110356 time to create 1 rle with old method : 0.11789441108703613 length of segment : 313 DEBUG bbox = [294, 444, 804, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004957914352416992 nb_pixel_total : 192285 time to create 1 rle with new method : 0.009166717529296875 length of segment : 502 DEBUG bbox = [690, 1728, 1224, 2070] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0032677650451660156 nb_pixel_total : 120985 time to create 1 rle with old method : 0.1300203800201416 length of segment : 509 DEBUG bbox = [1548, 2364, 1962, 2652] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015518665313720703 nb_pixel_total : 47870 time to create 1 rle with old method : 0.04909801483154297 length of segment : 354 DEBUG bbox = [1842, 558, 2094, 930] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013461112976074219 nb_pixel_total : 43575 time to create 1 rle with old method : 0.04680228233337402 length of segment : 198 DEBUG bbox = [1416, 1044, 1578, 1182] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004925727844238281 nb_pixel_total : 16835 time to create 1 rle with old method : 0.01776599884033203 length of segment : 161 DEBUG bbox = [234, 2568, 498, 2886] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001293182373046875 nb_pixel_total : 55249 time to create 1 rle with old method : 0.058896541595458984 length of segment : 267 DEBUG bbox = [1638, 894, 1860, 1236] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012066364288330078 nb_pixel_total : 34104 time to create 1 rle with old method : 0.03850555419921875 length of segment : 194 DEBUG bbox = [1722, 690, 2004, 1014] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008981227874755859 nb_pixel_total : 45087 time to create 1 rle with old method : 0.04728960990905762 length of segment : 313 DEBUG bbox = [1710, 2022, 1968, 2214] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009286403656005859 nb_pixel_total : 25380 time to create 1 rle with old method : 0.027243614196777344 length of segment : 234 DEBUG bbox = [48, 1314, 378, 1584] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013744831085205078 nb_pixel_total : 30553 time to create 1 rle with old method : 0.03241896629333496 length of segment : 270 DEBUG bbox = [390, 276, 606, 576] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009887218475341797 nb_pixel_total : 36832 time to create 1 rle with old method : 0.03973054885864258 length of segment : 201 DEBUG bbox = [798, 2826, 1218, 3090] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018041133880615234 nb_pixel_total : 58542 time to create 1 rle with old method : 0.060739994049072266 length of segment : 516 DEBUG bbox = [1056, 2820, 1194, 2946] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00018453598022460938 nb_pixel_total : 12004 time to create 1 rle with old method : 0.012731552124023438 length of segment : 127 DEBUG bbox = [1548, 1188, 1854, 1374] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008609294891357422 nb_pixel_total : 11787 time to create 1 rle with old method : 0.012795448303222656 length of segment : 388 DEBUG bbox = [1434, 1218, 1554, 1344] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00035262107849121094 nb_pixel_total : 9741 time to create 1 rle with old method : 0.011037826538085938 length of segment : 105 DEBUG bbox = [186, 1236, 450, 2406] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0033915042877197266 nb_pixel_total : 128807 time to create 1 rle with old method : 0.13684535026550293 length of segment : 176 DEBUG bbox = [1632, 1710, 2034, 2046] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001983165740966797 nb_pixel_total : 94824 time to create 1 rle with old method : 0.0987398624420166 length of segment : 404 DEBUG bbox = [1692, 1392, 2070, 1764] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015730857849121094 nb_pixel_total : 95799 time to create 1 rle with old method : 0.10361766815185547 length of segment : 317 DEBUG bbox = [1728, 1944, 2124, 2730] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0041501522064208984 nb_pixel_total : 222091 time to create 1 rle with new method : 0.008776426315307617 length of segment : 375 DEBUG bbox = [12, 3180, 402, 3294] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009405612945556641 nb_pixel_total : 29048 time to create 1 rle with old method : 0.030766725540161133 length of segment : 392 DEBUG bbox = [2070, 1986, 2148, 2166] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 8839 time to create 1 rle with old method : 0.010027408599853516 length of segment : 77 DEBUG bbox = [1386, 744, 1842, 1176] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002222299575805664 nb_pixel_total : 103583 time to create 1 rle with old method : 0.1073904037475586 length of segment : 393 DEBUG bbox = [1866, 564, 1998, 816] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00055694580078125 nb_pixel_total : 20923 time to create 1 rle with old method : 0.02198648452758789 length of segment : 121 DEBUG bbox = [1242, 462, 1722, 1086] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034842491149902344 nb_pixel_total : 152552 time to create 1 rle with new method : 0.008192062377929688 length of segment : 524 DEBUG bbox = [1548, 936, 1638, 1080] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 7273 time to create 1 rle with old method : 0.008402347564697266 length of segment : 78 DEBUG bbox = [540, 330, 870, 684] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015368461608886719 nb_pixel_total : 76065 time to create 1 rle with old method : 0.08049464225769043 length of segment : 288 DEBUG bbox = [1164, 870, 1566, 1242] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001394033432006836 nb_pixel_total : 83671 time to create 1 rle with old method : 0.08667230606079102 length of segment : 369 DEBUG bbox = [144, 1968, 798, 2520] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0039021968841552734 nb_pixel_total : 155751 time to create 1 rle with new method : 0.009808063507080078 length of segment : 584 DEBUG bbox = [1284, 1374, 1620, 1806] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017230510711669922 nb_pixel_total : 96593 time to create 1 rle with old method : 0.10068702697753906 length of segment : 279 DEBUG bbox = [840, 1638, 1218, 2034] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019469261169433594 nb_pixel_total : 106839 time to create 1 rle with old method : 0.11345267295837402 length of segment : 395 DEBUG bbox = [1416, 1788, 1692, 2178] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011501312255859375 nb_pixel_total : 57499 time to create 1 rle with old method : 0.05914878845214844 length of segment : 328 DEBUG bbox = [912, 1884, 1410, 2460] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024895668029785156 nb_pixel_total : 73709 time to create 1 rle with old method : 0.07659268379211426 length of segment : 436 DEBUG bbox = [540, 1092, 696, 1242] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004715919494628906 nb_pixel_total : 14033 time to create 1 rle with old method : 0.014914751052856445 length of segment : 130 DEBUG bbox = [636, 1116, 840, 1284] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005466938018798828 nb_pixel_total : 12146 time to create 1 rle with old method : 0.012918710708618164 length of segment : 171 DEBUG bbox = [834, 1668, 1326, 2280] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0038785934448242188 nb_pixel_total : 189198 time to create 1 rle with new method : 0.00806283950805664 length of segment : 453 DEBUG bbox = [1962, 1500, 2154, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007581710815429688 nb_pixel_total : 29108 time to create 1 rle with old method : 0.03163576126098633 length of segment : 167 DEBUG bbox = [240, 540, 414, 738] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005509853363037109 nb_pixel_total : 20461 time to create 1 rle with old method : 0.022853851318359375 length of segment : 159 DEBUG bbox = [516, 2646, 840, 2778] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007545948028564453 nb_pixel_total : 23071 time to create 1 rle with old method : 0.024850130081176758 length of segment : 290 DEBUG bbox = [6, 1626, 150, 1962] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007476806640625 nb_pixel_total : 34040 time to create 1 rle with old method : 0.036322593688964844 length of segment : 137 DEBUG bbox = [1608, 918, 1968, 1350] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019884109497070312 nb_pixel_total : 82440 time to create 1 rle with old method : 0.08703947067260742 length of segment : 358 DEBUG bbox = [564, 2808, 1242, 3270] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036149024963378906 nb_pixel_total : 174995 time to create 1 rle with new method : 0.00948643684387207 length of segment : 555 DEBUG bbox = [222, 750, 372, 912] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00033473968505859375 nb_pixel_total : 13614 time to create 1 rle with old method : 0.015038728713989258 length of segment : 134 DEBUG bbox = [576, 522, 810, 708] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008637905120849609 nb_pixel_total : 28696 time to create 1 rle with old method : 0.031077861785888672 length of segment : 230 DEBUG bbox = [252, 2238, 624, 2790] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002615690231323242 nb_pixel_total : 90645 time to create 1 rle with old method : 0.0924520492553711 length of segment : 297 DEBUG bbox = [366, 282, 654, 678] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016019344329833984 nb_pixel_total : 49294 time to create 1 rle with old method : 0.05430102348327637 length of segment : 278 DEBUG bbox = [216, 510, 408, 696] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006201267242431641 nb_pixel_total : 21969 time to create 1 rle with old method : 0.023679256439208984 length of segment : 156 DEBUG bbox = [18, 2502, 246, 2766] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010166168212890625 nb_pixel_total : 45196 time to create 1 rle with old method : 0.04828810691833496 length of segment : 221 DEBUG bbox = [1986, 774, 2148, 1008] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006589889526367188 nb_pixel_total : 25147 time to create 1 rle with old method : 0.02594923973083496 length of segment : 161 DEBUG bbox = [492, 2952, 900, 3072] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011518001556396484 nb_pixel_total : 29713 time to create 1 rle with old method : 0.03190469741821289 length of segment : 430 DEBUG bbox = [348, 930, 792, 1644] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004326343536376953 nb_pixel_total : 169398 time to create 1 rle with new method : 0.009664535522460938 length of segment : 397 DEBUG bbox = [1188, 918, 1482, 1362] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002116680145263672 nb_pixel_total : 80156 time to create 1 rle with old method : 0.08413362503051758 length of segment : 371 DEBUG bbox = [1278, 1890, 1614, 2292] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018792152404785156 nb_pixel_total : 57397 time to create 1 rle with old method : 0.06071162223815918 length of segment : 280 DEBUG bbox = [612, 306, 936, 540] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001001596450805664 nb_pixel_total : 40712 time to create 1 rle with old method : 0.0435328483581543 length of segment : 291 DEBUG bbox = [1704, 1548, 2130, 2082] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003161907196044922 nb_pixel_total : 149901 time to create 1 rle with old method : 0.18699979782104492 length of segment : 471 DEBUG bbox = [798, 2064, 1224, 2454] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002486705780029297 nb_pixel_total : 101588 time to create 1 rle with old method : 0.1058652400970459 length of segment : 386 DEBUG bbox = [762, 1164, 1356, 1728] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00447845458984375 nb_pixel_total : 176770 time to create 1 rle with new method : 0.0098419189453125 length of segment : 516 DEBUG bbox = [216, 2928, 432, 3216] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001001596450805664 nb_pixel_total : 47976 time to create 1 rle with old method : 0.05086708068847656 length of segment : 227 DEBUG bbox = [1806, 1524, 2040, 1812] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00060272216796875 nb_pixel_total : 38662 time to create 1 rle with old method : 0.04326200485229492 length of segment : 197 DEBUG bbox = [354, 762, 768, 1074] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002079010009765625 nb_pixel_total : 78071 time to create 1 rle with old method : 0.08539867401123047 length of segment : 355 DEBUG bbox = [546, 288, 1020, 930] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003835439682006836 nb_pixel_total : 163492 time to create 1 rle with new method : 0.008881568908691406 length of segment : 408 DEBUG bbox = [1032, 792, 1602, 1206] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003504514694213867 nb_pixel_total : 172680 time to create 1 rle with new method : 0.007575511932373047 length of segment : 551 DEBUG bbox = [432, 1356, 810, 1704] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00194549560546875 nb_pixel_total : 58247 time to create 1 rle with old method : 0.06515908241271973 length of segment : 290 DEBUG bbox = [1902, 2166, 2130, 2556] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013494491577148438 nb_pixel_total : 66858 time to create 1 rle with old method : 0.07206869125366211 length of segment : 304 DEBUG bbox = [1398, 420, 1746, 828] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020704269409179688 nb_pixel_total : 97313 time to create 1 rle with old method : 0.10466122627258301 length of segment : 341 DEBUG bbox = [2070, 1434, 2154, 1650] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006124973297119141 nb_pixel_total : 10344 time to create 1 rle with old method : 0.013574600219726562 length of segment : 83 time spent for convertir_results : 8.036691188812256 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 83 chid ids of type : 3594 Number RLEs to save : 25751 save missing photos in datou_result : time spend for datou_step_exec : 51.07042574882507 time spend to save output : 1.5394859313964844 total time spend for step 1 : 52.60991168022156 step2:crop_condition Sat Jan 10 19:41:24 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 83 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768070497_618340 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451637_0.png', 0, 887, 730, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451638_0.png', 0, 304, 350, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451640_0.png', 0, 471, 257, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451643_0.png', 0, 312, 202, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451644_0.png', 0, 462, 385, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451646_0.png', 0, 291, 229, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451649_0.png', 0, 105, 91, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451654_0.png', 0, 212, 359, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451656_0.png', 0, 128, 160, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451662_0.png', 0, 259, 191, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451663_0.png', 0, 254, 376, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451664_0.png', 0, 122, 127, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451665_0.png', 0, 143, 291, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451671_0.png', 0, 112, 389, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451672_0.png', 0, 166, 77, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451676_0.png', 0, 109, 78, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451678_0.png', 0, 341, 357, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451679_0.png', 0, 522, 563, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451682_0.png', 0, 385, 266, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451684_0.png', 0, 148, 130, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451685_0.png', 0, 141, 171, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451686_0.png', 0, 561, 452, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451688_0.png', 0, 193, 159, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451689_0.png', 0, 131, 281, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451694_0.png', 0, 174, 230, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451696_0.png', 0, 383, 240, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451697_0.png', 0, 182, 155, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451699_0.png', 0, 205, 160, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451700_0.png', 0, 113, 392, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451701_0.png', 0, 709, 371, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451702_0.png', 0, 413, 280, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451704_0.png', 0, 206, 287, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451707_0.png', 0, 504, 516, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451710_0.png', 0, 298, 355, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451712_0.png', 0, 390, 549, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451713_0.png', 0, 319, 287, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070504), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451716_0.png', 0, 174, 81, 0, 1768070504,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.628750085830688 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768070509_618340 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070510), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451634_0.png', 0, 164, 205, 0, 1768070510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070510), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451650_0.png', 0, 376, 212, 0, 1768070510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070510), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451657_0.png', 0, 273, 234, 0, 1768070510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070510), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451673_0.png', 0, 401, 393, 0, 1768070510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070510), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451706_0.png', 0, 379, 386, 0, 1768070510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9344854354858398 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768070513_618340 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070513), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451674_0.png', 0, 229, 120, 0, 1768070513,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070513), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451681_0.png', 0, 393, 346, 0, 1768070513,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070513), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451693_0.png', 0, 117, 132, 0, 1768070513,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1588480472564697 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768070529_618340 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451635_0.png', 0, 445, 558, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451639_0.png', 0, 819, 562, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451641_0.png', 0, 233, 260, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451642_0.png', 0, 170, 154, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451645_0.png', 0, 126, 272, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451647_0.png', 0, 300, 206, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451648_0.png', 0, 242, 427, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451651_0.png', 0, 579, 265, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451652_0.png', 0, 655, 436, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451653_0.png', 0, 314, 508, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451655_0.png', 0, 319, 198, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451658_0.png', 0, 299, 191, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451659_0.png', 0, 264, 261, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451661_0.png', 0, 209, 269, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451667_0.png', 0, 971, 172, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451668_0.png', 0, 317, 370, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451669_0.png', 0, 369, 316, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451670_0.png', 0, 714, 375, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451675_0.png', 0, 590, 451, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451677_0.png', 0, 330, 288, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451680_0.png', 0, 415, 270, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451683_0.png', 0, 432, 435, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451687_0.png', 0, 273, 164, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451690_0.png', 0, 309, 132, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451691_0.png', 0, 358, 334, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451692_0.png', 0, 370, 539, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451695_0.png', 0, 534, 266, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451698_0.png', 0, 258, 216, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451703_0.png', 0, 345, 260, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451705_0.png', 0, 520, 403, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451709_0.png', 0, 258, 197, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451711_0.png', 0, 612, 387, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070535), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451714_0.png', 0, 383, 222, 0, 1768070535,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.844002962112427 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768070538_618340 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070539), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451636_0.png', 0, 339, 239, 0, 1768070539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070539), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451666_0.png', 0, 124, 105, 0, 1768070539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070539), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451708_0.png', 0, 285, 211, 0, 1768070539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070539), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451715_0.png', 0, 350, 341, 0, 1768070539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.060070276260376 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768070540_618340 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768070541), 0.0, 0.0, 14, '', 0, 0, '1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451660_0.png', 0, 167, 234, 0, 1768070541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8987739086151123 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1403321658, 1403321656, 1403321637, 1403321636, 1403321635, 1403321634, 1403321633, 1403321632] Looping around the photos to save general results len do output : 83 /1403325078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403325173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321658', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321656', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321637', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321636', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321635', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321634', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321633', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321632', None, None, None, None, None, '4328362') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 257 time used for this insertion : 0.025339365005493164 save_final save missing photos in datou_result : time spend for datou_step_exec : 56.81137442588806 time spend to save output : 0.02866983413696289 total time spend for step 2 : 56.840044260025024 step3:rle_unique_nms_with_priority Sat Jan 10 19:42:21 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 83 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 6.327493906021118 time for calcul the mask position with numpy : 0.6001286506652832 nb_pixel_total : 6815392 time to create 1 rle with new method : 0.8488137722015381 time for calcul the mask position with numpy : 0.04002499580383301 nb_pixel_total : 38711 time to create 1 rle with old method : 0.04660463333129883 time for calcul the mask position with numpy : 0.025999784469604492 nb_pixel_total : 7746 time to create 1 rle with old method : 0.008362054824829102 time for calcul the mask position with numpy : 0.025351762771606445 nb_pixel_total : 154270 time to create 1 rle with new method : 0.7672872543334961 time for calcul the mask position with numpy : 0.024167537689208984 nb_pixel_total : 38722 time to create 1 rle with old method : 0.0417332649230957 time for calcul the mask position with numpy : 0.02507185935974121 nb_pixel_total : 18360 time to create 1 rle with old method : 0.019279003143310547 time for calcul the mask position with numpy : 0.02356863021850586 nb_pixel_total : 51582 time to create 1 rle with old method : 0.054442644119262695 time for calcul the mask position with numpy : 0.026183366775512695 nb_pixel_total : 106202 time to create 1 rle with old method : 0.11318206787109375 time for calcul the mask position with numpy : 0.027307510375976562 nb_pixel_total : 342847 time to create 1 rle with new method : 0.5500574111938477 time for calcul the mask position with numpy : 0.02349257469177246 nb_pixel_total : 62681 time to create 1 rle with old method : 0.06331539154052734 time for calcul the mask position with numpy : 0.025905370712280273 nb_pixel_total : 381780 time to create 1 rle with new method : 0.685208797454834 time for calcul the mask position with numpy : 0.024547576904296875 nb_pixel_total : 60621 time to create 1 rle with old method : 0.06454229354858398 time for calcul the mask position with numpy : 0.02489757537841797 nb_pixel_total : 187494 time to create 1 rle with new method : 0.6814653873443604 time for calcul the mask position with numpy : 0.023220300674438477 nb_pixel_total : 27992 time to create 1 rle with old method : 0.028482437133789062 create new chi : 5.066277265548706 time to delete rle : 0.021195411682128906 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 11346 TO DO : save crop sub photo not yet done ! save time : 0.7473337650299072 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.490447759628296 time for calcul the mask position with numpy : 0.5843110084533691 nb_pixel_total : 7651444 time to create 1 rle with new method : 0.866553544998169 time for calcul the mask position with numpy : 0.0396418571472168 nb_pixel_total : 47870 time to create 1 rle with old method : 0.04886460304260254 time for calcul the mask position with numpy : 0.04058837890625 nb_pixel_total : 120985 time to create 1 rle with old method : 0.12647151947021484 time for calcul the mask position with numpy : 0.03888249397277832 nb_pixel_total : 192285 time to create 1 rle with new method : 0.673060417175293 time for calcul the mask position with numpy : 0.03742074966430664 nb_pixel_total : 110356 time to create 1 rle with old method : 0.11456084251403809 time for calcul the mask position with numpy : 0.0349583625793457 nb_pixel_total : 42784 time to create 1 rle with old method : 0.04528331756591797 time for calcul the mask position with numpy : 0.03580522537231445 nb_pixel_total : 8430 time to create 1 rle with old method : 0.008970975875854492 time for calcul the mask position with numpy : 0.029040098190307617 nb_pixel_total : 74178 time to create 1 rle with old method : 0.08317279815673828 time for calcul the mask position with numpy : 0.02405571937561035 nb_pixel_total : 46068 time to create 1 rle with old method : 0.046807050704956055 create new chi : 2.9451851844787598 time to delete rle : 0.0010304450988769531 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7392 TO DO : save crop sub photo not yet done ! save time : 0.47090578079223633 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 4.162908315658569 time for calcul the mask position with numpy : 0.6731584072113037 nb_pixel_total : 7947540 time to create 1 rle with new method : 0.6890225410461426 time for calcul the mask position with numpy : 0.04053759574890137 nb_pixel_total : 2372 time to create 1 rle with old method : 0.003151416778564453 time for calcul the mask position with numpy : 0.027419090270996094 nb_pixel_total : 58542 time to create 1 rle with old method : 0.0826113224029541 time for calcul the mask position with numpy : 0.02404499053955078 nb_pixel_total : 36832 time to create 1 rle with old method : 0.038244009017944336 time for calcul the mask position with numpy : 0.024356842041015625 nb_pixel_total : 30553 time to create 1 rle with old method : 0.03299832344055176 time for calcul the mask position with numpy : 0.023736953735351562 nb_pixel_total : 25380 time to create 1 rle with old method : 0.026526451110839844 time for calcul the mask position with numpy : 0.024205446243286133 nb_pixel_total : 43418 time to create 1 rle with old method : 0.0446469783782959 time for calcul the mask position with numpy : 0.025118112564086914 nb_pixel_total : 34104 time to create 1 rle with old method : 0.03511404991149902 time for calcul the mask position with numpy : 0.024376392364501953 nb_pixel_total : 55249 time to create 1 rle with old method : 0.05910015106201172 time for calcul the mask position with numpy : 0.02425527572631836 nb_pixel_total : 16835 time to create 1 rle with old method : 0.018080472946166992 time for calcul the mask position with numpy : 0.024058103561401367 nb_pixel_total : 43575 time to create 1 rle with old method : 0.046643972396850586 create new chi : 2.054424285888672 time to delete rle : 0.0010533332824707031 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6914 TO DO : save crop sub photo not yet done ! save time : 0.4446861743927002 nb_obj : 10 nb_hashtags : 5 time to prepare the origin masks : 4.400822401046753 time for calcul the mask position with numpy : 0.5825762748718262 nb_pixel_total : 7572961 time to create 1 rle with new method : 0.7551395893096924 time for calcul the mask position with numpy : 0.027870655059814453 nb_pixel_total : 20923 time to create 1 rle with old method : 0.026369094848632812 time for calcul the mask position with numpy : 0.030675411224365234 nb_pixel_total : 103583 time to create 1 rle with old method : 0.1177208423614502 time for calcul the mask position with numpy : 0.0372312068939209 nb_pixel_total : 4836 time to create 1 rle with old method : 0.005053281784057617 time for calcul the mask position with numpy : 0.037116289138793945 nb_pixel_total : 29048 time to create 1 rle with old method : 0.030078887939453125 time for calcul the mask position with numpy : 0.025072574615478516 nb_pixel_total : 222091 time to create 1 rle with new method : 0.7068455219268799 time for calcul the mask position with numpy : 0.024164676666259766 nb_pixel_total : 95799 time to create 1 rle with old method : 0.09878873825073242 time for calcul the mask position with numpy : 0.022832870483398438 nb_pixel_total : 94824 time to create 1 rle with old method : 0.09691548347473145 time for calcul the mask position with numpy : 0.024125337600708008 nb_pixel_total : 128807 time to create 1 rle with old method : 0.14584088325500488 time for calcul the mask position with numpy : 0.024566650390625 nb_pixel_total : 9741 time to create 1 rle with old method : 0.010489225387573242 time for calcul the mask position with numpy : 0.025465726852416992 nb_pixel_total : 11787 time to create 1 rle with old method : 0.012664556503295898 create new chi : 2.9379749298095703 time to delete rle : 0.0012459754943847656 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7579 TO DO : save crop sub photo not yet done ! save time : 0.48417043685913086 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 3.647679567337036 time for calcul the mask position with numpy : 0.5412228107452393 nb_pixel_total : 7486034 time to create 1 rle with new method : 0.6225597858428955 time for calcul the mask position with numpy : 0.029537200927734375 nb_pixel_total : 14033 time to create 1 rle with old method : 0.014611005783081055 time for calcul the mask position with numpy : 0.023282527923583984 nb_pixel_total : 73709 time to create 1 rle with old method : 0.07491350173950195 time for calcul the mask position with numpy : 0.02359151840209961 nb_pixel_total : 57499 time to create 1 rle with old method : 0.05903005599975586 time for calcul the mask position with numpy : 0.023683547973632812 nb_pixel_total : 106839 time to create 1 rle with old method : 0.10922884941101074 time for calcul the mask position with numpy : 0.023801088333129883 nb_pixel_total : 96593 time to create 1 rle with old method : 0.09808731079101562 time for calcul the mask position with numpy : 0.02348494529724121 nb_pixel_total : 155751 time to create 1 rle with new method : 0.6610443592071533 time for calcul the mask position with numpy : 0.024181604385375977 nb_pixel_total : 68213 time to create 1 rle with old method : 0.06982135772705078 time for calcul the mask position with numpy : 0.024352073669433594 nb_pixel_total : 76065 time to create 1 rle with old method : 0.08042693138122559 time for calcul the mask position with numpy : 0.023431062698364258 nb_pixel_total : 7112 time to create 1 rle with old method : 0.0073795318603515625 time for calcul the mask position with numpy : 0.024201154708862305 nb_pixel_total : 152552 time to create 1 rle with new method : 0.6841607093811035 create new chi : 3.35600209236145 time to delete rle : 0.0021865367889404297 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8686 TO DO : save crop sub photo not yet done ! save time : 0.5408174991607666 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 4.06385612487793 time for calcul the mask position with numpy : 0.482546329498291 nb_pixel_total : 7715327 time to create 1 rle with new method : 0.7663707733154297 time for calcul the mask position with numpy : 0.024529457092285156 nb_pixel_total : 13614 time to create 1 rle with old method : 0.022188425064086914 time for calcul the mask position with numpy : 0.027758359909057617 nb_pixel_total : 174995 time to create 1 rle with new method : 0.7079436779022217 time for calcul the mask position with numpy : 0.023726940155029297 nb_pixel_total : 82440 time to create 1 rle with old method : 0.08608460426330566 time for calcul the mask position with numpy : 0.023580312728881836 nb_pixel_total : 34040 time to create 1 rle with old method : 0.03456759452819824 time for calcul the mask position with numpy : 0.023210763931274414 nb_pixel_total : 23071 time to create 1 rle with old method : 0.023955583572387695 time for calcul the mask position with numpy : 0.023886919021606445 nb_pixel_total : 20461 time to create 1 rle with old method : 0.022092819213867188 time for calcul the mask position with numpy : 0.02430868148803711 nb_pixel_total : 29108 time to create 1 rle with old method : 0.02980637550354004 time for calcul the mask position with numpy : 0.024533510208129883 nb_pixel_total : 189198 time to create 1 rle with new method : 0.842703104019165 time for calcul the mask position with numpy : 0.0242464542388916 nb_pixel_total : 12146 time to create 1 rle with old method : 0.013074398040771484 create new chi : 3.339672565460205 time to delete rle : 0.0009391307830810547 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 7008 TO DO : save crop sub photo not yet done ! save time : 0.4548165798187256 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 4.167138338088989 time for calcul the mask position with numpy : 0.4790377616882324 nb_pixel_total : 7656077 time to create 1 rle with new method : 0.7194466590881348 time for calcul the mask position with numpy : 0.026634931564331055 nb_pixel_total : 40712 time to create 1 rle with old method : 0.041292428970336914 time for calcul the mask position with numpy : 0.022562026977539062 nb_pixel_total : 57397 time to create 1 rle with old method : 0.05770301818847656 time for calcul the mask position with numpy : 0.023430585861206055 nb_pixel_total : 80156 time to create 1 rle with old method : 0.08132791519165039 time for calcul the mask position with numpy : 0.02396535873413086 nb_pixel_total : 169398 time to create 1 rle with new method : 0.6816425323486328 time for calcul the mask position with numpy : 0.023825407028198242 nb_pixel_total : 29713 time to create 1 rle with old method : 0.03060317039489746 time for calcul the mask position with numpy : 0.024582386016845703 nb_pixel_total : 25147 time to create 1 rle with old method : 0.02616715431213379 time for calcul the mask position with numpy : 0.02346324920654297 nb_pixel_total : 45196 time to create 1 rle with old method : 0.05479264259338379 time for calcul the mask position with numpy : 0.02765488624572754 nb_pixel_total : 21969 time to create 1 rle with old method : 0.03580188751220703 time for calcul the mask position with numpy : 0.023859739303588867 nb_pixel_total : 49294 time to create 1 rle with old method : 0.05012226104736328 time for calcul the mask position with numpy : 0.023723602294921875 nb_pixel_total : 90645 time to create 1 rle with old method : 0.09127926826477051 time for calcul the mask position with numpy : 0.023066997528076172 nb_pixel_total : 28696 time to create 1 rle with old method : 0.029500246047973633 create new chi : 2.707458257675171 time to delete rle : 0.0011949539184570312 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8384 TO DO : save crop sub photo not yet done ! save time : 0.5216019153594971 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 4.865300178527832 time for calcul the mask position with numpy : 0.5543200969696045 nb_pixel_total : 7168275 time to create 1 rle with new method : 1.2484054565429688 time for calcul the mask position with numpy : 0.024723052978515625 nb_pixel_total : 10344 time to create 1 rle with old method : 0.010836124420166016 time for calcul the mask position with numpy : 0.024753332138061523 nb_pixel_total : 97313 time to create 1 rle with old method : 0.10287046432495117 time for calcul the mask position with numpy : 0.02544403076171875 nb_pixel_total : 66858 time to create 1 rle with old method : 0.08060669898986816 time for calcul the mask position with numpy : 0.023972034454345703 nb_pixel_total : 58247 time to create 1 rle with old method : 0.05993175506591797 time for calcul the mask position with numpy : 0.024359703063964844 nb_pixel_total : 172680 time to create 1 rle with new method : 0.6872885227203369 time for calcul the mask position with numpy : 0.02425837516784668 nb_pixel_total : 163492 time to create 1 rle with new method : 0.6039097309112549 time for calcul the mask position with numpy : 0.02460503578186035 nb_pixel_total : 78071 time to create 1 rle with old method : 0.08359837532043457 time for calcul the mask position with numpy : 0.024176836013793945 nb_pixel_total : 2885 time to create 1 rle with old method : 0.003251314163208008 time for calcul the mask position with numpy : 0.024815797805786133 nb_pixel_total : 47976 time to create 1 rle with old method : 0.051795244216918945 time for calcul the mask position with numpy : 0.024822473526000977 nb_pixel_total : 176770 time to create 1 rle with new method : 0.7114822864532471 time for calcul the mask position with numpy : 0.02487659454345703 nb_pixel_total : 101588 time to create 1 rle with old method : 0.11193203926086426 time for calcul the mask position with numpy : 0.02781391143798828 nb_pixel_total : 149901 time to create 1 rle with old method : 0.1640002727508545 create new chi : 4.892857789993286 time to delete rle : 0.0014927387237548828 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10211 TO DO : save crop sub photo not yet done ! save time : 0.6269285678863525 map_output_result : {1403321658: (0.0, 'Should be the crop_list due to order', 0), 1403321656: (0.0, 'Should be the crop_list due to order', 0), 1403321637: (0.0, 'Should be the crop_list due to order', 0), 1403321636: (0.0, 'Should be the crop_list due to order', 0), 1403321635: (0.0, 'Should be the crop_list due to order', 0), 1403321634: (0.0, 'Should be the crop_list due to order', 0), 1403321633: (0.0, 'Should be the crop_list due to order', 0), 1403321632: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1403321658, 1403321656, 1403321637, 1403321636, 1403321635, 1403321634, 1403321633, 1403321632] Looping around the photos to save general results len do output : 8 /1403321658.Didn't retrieve data . /1403321656.Didn't retrieve data . /1403321637.Didn't retrieve data . /1403321636.Didn't retrieve data . /1403321635.Didn't retrieve data . /1403321634.Didn't retrieve data . /1403321633.Didn't retrieve data . /1403321632.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321658', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321656', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321637', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321636', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321635', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321634', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321633', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321632', None, None, None, None, None, '4328362') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015515804290771484 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.78642272949219 time spend to save output : 0.01587653160095215 total time spend for step 3 : 67.80229926109314 step4:ventilate_hashtags_in_portfolio Sat Jan 10 19:43:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30080405 get user id for portfolio 30080405 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30080405 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','mal_croppe','pehd','pet_clair','papier','environnement','flou','background','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30080405 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','mal_croppe','pehd','pet_clair','papier','environnement','flou','background','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30080405 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','mal_croppe','pehd','pet_clair','papier','environnement','flou','background','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30080444,30080445,30080446,30080447,30080448,30080449,30080450,30080451,30080452,30080453,30080454?tags=metal,autre,mal_croppe,pehd,pet_clair,papier,environnement,flou,background,carton,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1403321658, 1403321656, 1403321637, 1403321636, 1403321635, 1403321634, 1403321633, 1403321632] Looping around the photos to save general results len do output : 1 /30080405. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321658', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321656', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321637', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321636', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321635', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321634', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321633', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321632', None, None, None, None, None, '4328362') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016089916229248047 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9921705722808838 time spend to save output : 0.016339540481567383 total time spend for step 4 : 2.008510112762451 step5:final Sat Jan 10 19:43:31 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1403321658: ('0.09557879412615741',), 1403321656: ('0.09557879412615741',), 1403321637: ('0.09557879412615741',), 1403321636: ('0.09557879412615741',), 1403321635: ('0.09557879412615741',), 1403321634: ('0.09557879412615741',), 1403321633: ('0.09557879412615741',), 1403321632: ('0.09557879412615741',)} new output for save of step final : {1403321658: ('0.09557879412615741',), 1403321656: ('0.09557879412615741',), 1403321637: ('0.09557879412615741',), 1403321636: ('0.09557879412615741',), 1403321635: ('0.09557879412615741',), 1403321634: ('0.09557879412615741',), 1403321633: ('0.09557879412615741',), 1403321632: ('0.09557879412615741',)} [1403321658, 1403321656, 1403321637, 1403321636, 1403321635, 1403321634, 1403321633, 1403321632] Looping around the photos to save general results len do output : 8 /1403321658.Didn't retrieve data . /1403321656.Didn't retrieve data . /1403321637.Didn't retrieve data . /1403321636.Didn't retrieve data . /1403321635.Didn't retrieve data . /1403321634.Didn't retrieve data . /1403321633.Didn't retrieve data . /1403321632.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321658', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321656', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321637', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321636', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321635', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321634', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321633', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321632', None, None, None, None, None, '4328362') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.016864299774169922 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14258694648742676 time spend to save output : 0.01730179786682129 total time spend for step 5 : 0.15988874435424805 step6:blur_detection Sat Jan 10 19:43:31 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4.jpg resize: (2160, 3840) 1403321658 -6.039787779914546 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925.jpg resize: (2160, 3840) 1403321656 -6.076136981793978 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd.jpg resize: (2160, 3840) 1403321637 -6.133596068128875 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121.jpg resize: (2160, 3840) 1403321636 -5.192742369572855 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160.jpg resize: (2160, 3840) 1403321635 -5.312007512143011 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b.jpg resize: (2160, 3840) 1403321634 -6.17903946389708 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443.jpg resize: (2160, 3840) 1403321633 -6.1621083922155115 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c.jpg resize: (2160, 3840) 1403321632 -5.9850331251946765 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451637_0.png resize: (730, 887) 1403325078 -4.12477006501834 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451638_0.png resize: (350, 304) 1403325079 -4.605625940324228 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451640_0.png resize: (257, 471) 1403325080 -4.748779516083243 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451643_0.png resize: (202, 312) 1403325081 -2.9451493766305923 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451644_0.png resize: (385, 462) 1403325082 -4.370185729542505 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451646_0.png resize: (229, 291) 1403325084 -3.264987196781824 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451649_0.png resize: (91, 105) 1403325086 -0.1514133084856175 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451654_0.png resize: (359, 212) 1403325088 -4.185291769128371 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451656_0.png resize: (160, 128) 1403325089 -3.5899176803062454 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451662_0.png resize: (191, 259) 1403325090 -2.527053281291436 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451663_0.png resize: (376, 254) 1403325092 -4.383857222836108 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451664_0.png resize: (127, 122) 1403325093 -3.318462278886281 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451665_0.png resize: (291, 143) 1403325095 -3.6460592804190037 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451671_0.png resize: (389, 112) 1403325096 -4.557073601476128 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451672_0.png resize: (77, 166) 1403325098 -3.7212419692840997 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451676_0.png resize: (78, 109) 1403325099 -3.0804524922339085 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451678_0.png resize: (357, 341) 1403325100 -4.302326834659301 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451679_0.png resize: (563, 522) 1403325101 -4.734214162475625 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451682_0.png resize: (266, 385) 1403325102 -4.906706283878137 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451684_0.png resize: (130, 148) 1403325103 -3.9537096340557683 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451685_0.png resize: (171, 141) 1403325104 -4.591316603844739 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451686_0.png resize: (452, 561) 1403325105 -5.0759186427811525 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451688_0.png resize: (159, 193) 1403325106 -4.773761570951429 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451689_0.png resize: (281, 131) 1403325107 -2.972455331631998 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451694_0.png resize: (230, 174) 1403325108 -3.9588110550071822 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451696_0.png resize: (240, 383) 1403325109 -4.0911947368838515 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451697_0.png resize: (155, 182) 1403325110 -3.6950548244618737 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451699_0.png resize: (160, 205) 1403325111 -3.8557131221137855 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451700_0.png resize: (392, 113) 1403325112 -2.489767175276057 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451701_0.png resize: (371, 709) 1403325113 -4.554357596908326 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451702_0.png resize: (280, 413) 1403325114 -3.9415758072719043 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451704_0.png resize: (287, 206) 1403325115 -4.198837150734316 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451707_0.png resize: (516, 504) 1403325116 -4.7766968115118384 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451710_0.png resize: (355, 298) 1403325117 -5.278264309589471 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451712_0.png resize: (549, 390) 1403325118 -5.057117118983889 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451713_0.png resize: (287, 319) 1403325119 -4.313074547938825 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451716_0.png resize: (81, 174) 1403325120 -4.587973209723575 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451634_0.png resize: (205, 164) 1403325123 -2.006185823840546 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451650_0.png resize: (212, 376) 1403325124 -3.1902462574393535 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451657_0.png resize: (234, 273) 1403325125 -3.177788614910832 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451673_0.png resize: (393, 401) 1403325126 -5.943616684185534 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451706_0.png resize: (386, 379) 1403325127 -4.578644686195892 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451674_0.png resize: (120, 229) 1403325128 -4.552024784813938 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451681_0.png resize: (346, 393) 1403325129 -4.563613450920933 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451693_0.png resize: (132, 117) 1403325130 -3.7499358910608485 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451635_0.png resize: (558, 445) 1403325134 -3.798293496758296 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451639_0.png resize: (562, 819) 1403325135 -5.989616596869867 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451641_0.png resize: (260, 233) 1403325136 -3.2051686727210997 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451642_0.png resize: (154, 170) 1403325137 -4.07845751367951 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451645_0.png resize: (272, 126) 1403325138 -4.782324365143252 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451647_0.png resize: (206, 300) 1403325139 -3.3578098627496735 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451648_0.png resize: (427, 242) 1403325140 -4.693150444076101 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451651_0.png resize: (265, 579) 1403325141 -4.002768642072026 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451652_0.png resize: (436, 655) 1403325142 -4.661367141135527 treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451653_0.png resize: (508, 314) 1403325143 -4.370387118366027 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451655_0.png resize: (198, 319) 1403325144 -4.296707046445182 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451658_0.png resize: (191, 299) 1403325145 -4.291964750914895 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451659_0.png resize: (261, 264) 1403325146 -4.670237772413021 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451661_0.png resize: (269, 209) 1403325147 -3.0248028250458767 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451667_0.png resize: (172, 971) 1403325148 -3.0801432209320434 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451668_0.png resize: (370, 317) 1403325149 -5.2409001380422024 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451669_0.png resize: (316, 369) 1403325150 -4.638852119108116 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451670_0.png resize: (375, 714) 1403325151 -4.647939937510006 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451675_0.png resize: (451, 590) 1403325152 -4.579750011615783 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451677_0.png resize: (288, 330) 1403325153 -3.4149803099885094 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451680_0.png resize: (270, 415) 1403325154 -5.9467653241145975 treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451683_0.png resize: (435, 432) 1403325155 -3.2393647329393267 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451687_0.png resize: (164, 273) 1403325156 -3.919724378670196 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451690_0.png resize: (132, 309) 1403325157 -3.488949558711148 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451691_0.png resize: (334, 358) 1403325158 -5.534799547227356 treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451692_0.png resize: (539, 370) 1403325159 -4.680468981059972 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451695_0.png resize: (266, 534) 1403325160 -4.181674180841394 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451698_0.png resize: (216, 258) 1403325161 -4.537949106445501 treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451703_0.png resize: (260, 345) 1403325162 -4.141078917493282 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451705_0.png resize: (403, 520) 1403325163 -5.330683058719877 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451709_0.png resize: (197, 258) 1403325164 -5.182424909712371 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451711_0.png resize: (387, 612) 1403325165 -3.2580836202123904 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451714_0.png resize: (222, 383) 1403325166 -5.1538493114357244 treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451636_0.png resize: (239, 339) 1403325168 -2.997478912403274 treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451666_0.png resize: (105, 124) 1403325169 -4.261041785403716 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451708_0.png resize: (211, 285) 1403325170 -2.60631201983071 treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451715_0.png resize: (341, 350) 1403325171 -4.183241334223975 treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451660_0.png resize: (234, 167) 1403325173 -4.6595885139618485 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 91 time used for this insertion : 0.016927719116210938 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 91 time used for this insertion : 0.018839597702026367 save missing photos in datou_result : time spend for datou_step_exec : 30.572781085968018 time spend to save output : 0.042836666107177734 total time spend for step 6 : 30.615617752075195 step7:brightness Sat Jan 10 19:44:02 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4.jpg treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925.jpg treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd.jpg treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121.jpg treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160.jpg treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b.jpg treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443.jpg treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c.jpg treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451637_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451638_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451640_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451643_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451644_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451646_0.png treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451649_0.png treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451654_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451656_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451662_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451663_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451664_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451665_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451671_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451672_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451676_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451678_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451679_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451682_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451684_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451685_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451686_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451688_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451689_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451694_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451696_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451697_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451699_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451700_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451701_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451702_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451704_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451707_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451710_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451712_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451713_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451716_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451634_0.png treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451650_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451657_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451673_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451706_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451674_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451681_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451693_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451635_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451639_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451641_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451642_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451645_0.png treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451647_0.png treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451648_0.png treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451651_0.png treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451652_0.png treat image : temp/1768070430_618340_1403321656_d7e823960639c9cfce8411794b408925_rle_crop_4096451653_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451655_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451658_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451659_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451661_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451667_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451668_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451669_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451670_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451675_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451677_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451680_0.png treat image : temp/1768070430_618340_1403321635_e9b72aaac70fbb6cdb9df55033351160_rle_crop_4096451683_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451687_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451690_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451691_0.png treat image : temp/1768070430_618340_1403321634_f1eea5ce604ff7d07df10404d7c27b5b_rle_crop_4096451692_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451695_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451698_0.png treat image : temp/1768070430_618340_1403321633_2334b335621b47e850e2b2a6dc500443_rle_crop_4096451703_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451705_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451709_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451711_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451714_0.png treat image : temp/1768070430_618340_1403321658_cd4ce85f2b65776d3808fd863cdd52e4_rle_crop_4096451636_0.png treat image : temp/1768070430_618340_1403321636_df7f0bf48f26efa13822a17a705db121_rle_crop_4096451666_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451708_0.png treat image : temp/1768070430_618340_1403321632_7aff43b6fc1113711b8fec492a9ed66c_rle_crop_4096451715_0.png treat image : temp/1768070430_618340_1403321637_57be2f87185a3181b4bbf5aa850423fd_rle_crop_4096451660_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 91 time used for this insertion : 0.01872110366821289 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 91 time used for this insertion : 0.01759505271911621 save missing photos in datou_result : time spend for datou_step_exec : 8.294470310211182 time spend to save output : 0.04208874702453613 total time spend for step 7 : 8.336559057235718 step8:velours_tree Sat Jan 10 19:44:10 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10077786445617676 time spend to save output : 4.3392181396484375e-05 total time spend for step 8 : 0.10082125663757324 step9:send_mail_cod Sat Jan 10 19:44:10 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30080405_10-01-2026_19_44_10.pdf 30080444 change filename to text .change filename to text .change filename to text .imagette300804441768070650 30080445 change filename to text .change filename to text .change filename to text .change filename to text .imagette300804451768070650 30080446 imagette300804461768070651 30080447 imagette300804471768070651 30080448 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300804481768070651 30080449 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300804491768070653 30080451 imagette300804511768070655 30080452 imagette300804521768070655 30080453 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300804531768070655 30080454 change filename to text .imagette300804541768070656 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30080405 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30080444,30080445,30080446,30080447,30080448,30080449,30080450,30080451,30080452,30080453,30080454?tags=metal,autre,mal_croppe,pehd,pet_clair,papier,environnement,flou,background,carton,pet_fonce your option no_mail is active, we will not send the real mail to your client args[1403321658] : ((1403321658, -6.039787779914546, 492609224), (1403321658, -0.05222619057432366, 2107752395), '0.09557879412615741') We are sending mail with results at report@fotonower.com args[1403321656] : ((1403321656, -6.076136981793978, 492609224), (1403321656, -0.054098076507018984, 2107752395), '0.09557879412615741') We are sending mail with results at report@fotonower.com args[1403321637] : ((1403321637, -6.133596068128875, 492609224), (1403321637, -0.17285628899325803, 496442774), '0.09557879412615741') We are sending mail with results at report@fotonower.com args[1403321636] : ((1403321636, -5.192742369572855, 492609224), (1403321636, -0.8742307218195521, 501862349), '0.09557879412615741') We are sending mail with results at report@fotonower.com args[1403321635] : ((1403321635, -5.312007512143011, 492609224), (1403321635, -0.8507950213819052, 501862349), '0.09557879412615741') We are sending mail with results at report@fotonower.com args[1403321634] : ((1403321634, -6.17903946389708, 492609224), (1403321634, -0.3562081297915587, 496442774), '0.09557879412615741') We are sending mail with results at report@fotonower.com args[1403321633] : ((1403321633, -6.1621083922155115, 492609224), (1403321633, -0.12060183733058101, 496442774), '0.09557879412615741') We are sending mail with results at report@fotonower.com args[1403321632] : ((1403321632, -5.9850331251946765, 492609224), (1403321632, -0.19537748487293966, 496442774), '0.09557879412615741') We are sending mail with results at report@fotonower.com refus_total : 0.09557879412615741 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30080405 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30080405_10-01-2026_19_44_10.pdf results_Auto_P30080405_10-01-2026_19_44_10.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30080405_10-01-2026_19_44_10.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30080405','results_Auto_P30080405_10-01-2026_19_44_10.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30080405_10-01-2026_19_44_10.pdf','pdf','','0.75','0.09557879412615741') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1403321658, 1403321656, 1403321637, 1403321636, 1403321635, 1403321634, 1403321633, 1403321632] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321658', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321656', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321637', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321636', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321635', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321634', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321633', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321632', None, None, None, None, None, '4328362') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.016188859939575195 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.723656415939331 time spend to save output : 0.01644110679626465 total time spend for step 9 : 7.740097522735596 step10:split_time_score Sat Jan 10 19:44:18 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10012026 30080405 Nombre de photos uploadées : 8 / 23040 (0%) 10012026 30080405 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 10012026 30080405 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004429817199707031 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.27046680450439453 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.029496230870276873 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30077665_10-01-2026_11_35_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30077665 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30077665 AND mptpi.`type`=3726 To do Qualite : 0.03512266231141899 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30077875_10-01-2026_12_05_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30077875 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30077875 AND mptpi.`type`=3726 To do Qualite : 0.0914863227879169 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30078169_10-01-2026_13_06_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30078169 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30078169 AND mptpi.`type`=3726 To do Qualite : 0.013738929329817254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30078171_10-01-2026_13_05_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30078171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30078171 AND mptpi.`type`=3726 To do Qualite : 0.008768120624045254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30078428_10-01-2026_13_40_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30078428 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30078428 AND mptpi.`type`=3726 To do Qualite : 0.08733303996270575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30078431_10-01-2026_13_43_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30078431 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30078431 AND mptpi.`type`=3594 To do Qualite : 0.020435969383390422 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30079964_10-01-2026_18_11_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30079964 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30079964 AND mptpi.`type`=3726 To do Qualite : 0.103826915294684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30079966_10-01-2026_18_08_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30079966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30079966 AND mptpi.`type`=3726 To do Qualite : 0.08446903935185184 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30078803_10-01-2026_15_14_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30078803 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30078803 AND mptpi.`type`=3594 To do Qualite : 0.054493312757201644 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30078805_10-01-2026_15_13_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30078805 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30078805 AND mptpi.`type`=3594 To do Qualite : 0.02929665087013022 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30079400_10-01-2026_16_43_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30079400 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30079400 AND mptpi.`type`=3726 To do Qualite : 0.09557879412615741 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30080405_10-01-2026_19_44_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30080405 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30080405 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10012026': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1403321658, 1403321656, 1403321637, 1403321636, 1403321635, 1403321634, 1403321633, 1403321632] Looping around the photos to save general results len do output : 1 /30080405Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321658', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321656', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321637', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321636', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321635', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321634', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321633', None, None, None, None, None, '4328362') ('3318', None, None, None, None, None, None, None, '4328362') ('3318', '30080405', '1403321632', None, None, None, None, None, '4328362') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.015085220336914062 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3728036880493164 time spend to save output : 0.015245437622070312 total time spend for step 10 : 1.3880491256713867 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 107.20user 90.37system 3:53.96elapsed 84%CPU (0avgtext+0avgdata 4250464maxresident)k 1711664inputs+129480outputs (5867major+10157653minor)pagefaults 0swaps