python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 424857 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3978447'] with mtr_portfolio_ids : ['28056036'] and first list_photo_ids : [] new path : /proc/424857/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 2.770648956298828 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Nov 1 09:10:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-01 09:10:33.177733: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-01 09:10:33.206494: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-01 09:10:33.208553: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f72c8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-01 09:10:33.208585: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-01 09:10:33.212785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-01 09:10:33.458545: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x20984310 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-01 09:10:33.458614: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-01 09:10:33.460145: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-01 09:10:33.461488: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-01 09:10:33.477026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-01 09:10:33.483593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-01 09:10:33.485130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-01 09:10:33.496609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-01 09:10:33.499060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-01 09:10:33.509480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-01 09:10:33.511443: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-01 09:10:33.511535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-01 09:10:33.512734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-01 09:10:33.512755: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-01 09:10:33.512767: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-01 09:10:33.514647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-01 09:10:33.889280: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-01 09:10:33.889417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-01 09:10:33.889446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-01 09:10:33.889473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-01 09:10:33.889499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-01 09:10:33.889525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-01 09:10:33.889550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-01 09:10:33.889574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-01 09:10:33.891388: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-01 09:10:33.893332: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-01 09:10:33.893442: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-01 09:10:33.893473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-01 09:10:33.893499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-01 09:10:33.893527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-01 09:10:33.893553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-01 09:10:33.893583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-01 09:10:33.893610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-01 09:10:33.895487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-01 09:10:33.895559: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-01 09:10:33.895573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-01 09:10:33.895585: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-01 09:10:33.897579: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-01 09:10:46.664224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-01 09:10:46.881570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 425362 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 196 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00549626350402832 nb_pixel_total : 201763 time to create 1 rle with new method : 0.013666868209838867 length of segment : 567 time for calcul the mask position with numpy : 0.0006244182586669922 nb_pixel_total : 40916 time to create 1 rle with old method : 0.047243356704711914 length of segment : 407 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 28800 time to create 1 rle with old method : 0.03383898735046387 length of segment : 174 time for calcul the mask position with numpy : 0.0005371570587158203 nb_pixel_total : 28182 time to create 1 rle with old method : 0.03310847282409668 length of segment : 246 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 13203 time to create 1 rle with old method : 0.017478466033935547 length of segment : 107 time for calcul the mask position with numpy : 0.000537872314453125 nb_pixel_total : 29530 time to create 1 rle with old method : 0.037207841873168945 length of segment : 188 time for calcul the mask position with numpy : 0.0007340908050537109 nb_pixel_total : 57037 time to create 1 rle with old method : 0.07506537437438965 length of segment : 291 time for calcul the mask position with numpy : 0.00035119056701660156 nb_pixel_total : 16332 time to create 1 rle with old method : 0.022328853607177734 length of segment : 184 time for calcul the mask position with numpy : 0.0020923614501953125 nb_pixel_total : 70443 time to create 1 rle with old method : 0.09362292289733887 length of segment : 268 time for calcul the mask position with numpy : 0.0004830360412597656 nb_pixel_total : 23116 time to create 1 rle with old method : 0.027202129364013672 length of segment : 179 time for calcul the mask position with numpy : 0.0006372928619384766 nb_pixel_total : 28603 time to create 1 rle with old method : 0.0421450138092041 length of segment : 179 time for calcul the mask position with numpy : 0.0004279613494873047 nb_pixel_total : 24553 time to create 1 rle with old method : 0.030091285705566406 length of segment : 153 time for calcul the mask position with numpy : 0.0011532306671142578 nb_pixel_total : 68476 time to create 1 rle with old method : 0.08286452293395996 length of segment : 464 time for calcul the mask position with numpy : 0.0008242130279541016 nb_pixel_total : 28137 time to create 1 rle with old method : 0.03320431709289551 length of segment : 207 time for calcul the mask position with numpy : 0.0006682872772216797 nb_pixel_total : 32309 time to create 1 rle with old method : 0.03879690170288086 length of segment : 164 time for calcul the mask position with numpy : 0.0007851123809814453 nb_pixel_total : 38338 time to create 1 rle with old method : 0.04461264610290527 length of segment : 186 time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 31936 time to create 1 rle with old method : 0.038720130920410156 length of segment : 223 time for calcul the mask position with numpy : 0.000446319580078125 nb_pixel_total : 21720 time to create 1 rle with old method : 0.026005029678344727 length of segment : 192 time for calcul the mask position with numpy : 0.0010080337524414062 nb_pixel_total : 53422 time to create 1 rle with old method : 0.0619966983795166 length of segment : 312 time for calcul the mask position with numpy : 0.0035021305084228516 nb_pixel_total : 179168 time to create 1 rle with new method : 0.013016700744628906 length of segment : 524 time for calcul the mask position with numpy : 0.0013217926025390625 nb_pixel_total : 68606 time to create 1 rle with old method : 0.12400007247924805 length of segment : 320 time for calcul the mask position with numpy : 0.0006031990051269531 nb_pixel_total : 35757 time to create 1 rle with old method : 0.04228615760803223 length of segment : 308 time for calcul the mask position with numpy : 0.00021386146545410156 nb_pixel_total : 11176 time to create 1 rle with old method : 0.013918876647949219 length of segment : 93 time for calcul the mask position with numpy : 0.0006988048553466797 nb_pixel_total : 51095 time to create 1 rle with old method : 0.06542849540710449 length of segment : 219 time for calcul the mask position with numpy : 0.0022313594818115234 nb_pixel_total : 149747 time to create 1 rle with old method : 0.2019946575164795 length of segment : 556 time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 20361 time to create 1 rle with old method : 0.0278623104095459 length of segment : 247 time for calcul the mask position with numpy : 0.0024652481079101562 nb_pixel_total : 127023 time to create 1 rle with old method : 0.15557360649108887 length of segment : 389 time for calcul the mask position with numpy : 0.0019044876098632812 nb_pixel_total : 98856 time to create 1 rle with old method : 0.12025165557861328 length of segment : 362 time for calcul the mask position with numpy : 0.0018589496612548828 nb_pixel_total : 106695 time to create 1 rle with old method : 0.14235711097717285 length of segment : 452 time for calcul the mask position with numpy : 0.0013518333435058594 nb_pixel_total : 78270 time to create 1 rle with old method : 0.0983431339263916 length of segment : 449 time for calcul the mask position with numpy : 0.0007765293121337891 nb_pixel_total : 35749 time to create 1 rle with old method : 0.04615497589111328 length of segment : 194 time for calcul the mask position with numpy : 0.0012619495391845703 nb_pixel_total : 53048 time to create 1 rle with old method : 0.06254959106445312 length of segment : 288 time for calcul the mask position with numpy : 0.0005800724029541016 nb_pixel_total : 19611 time to create 1 rle with old method : 0.023363113403320312 length of segment : 136 time for calcul the mask position with numpy : 0.0012214183807373047 nb_pixel_total : 63774 time to create 1 rle with old method : 0.07519865036010742 length of segment : 210 time for calcul the mask position with numpy : 0.0019609928131103516 nb_pixel_total : 74481 time to create 1 rle with old method : 0.0862877368927002 length of segment : 533 time for calcul the mask position with numpy : 0.001146554946899414 nb_pixel_total : 33231 time to create 1 rle with old method : 0.03943681716918945 length of segment : 262 time for calcul the mask position with numpy : 0.0011794567108154297 nb_pixel_total : 46160 time to create 1 rle with old method : 0.06828951835632324 length of segment : 233 time for calcul the mask position with numpy : 0.0003802776336669922 nb_pixel_total : 13431 time to create 1 rle with old method : 0.016126632690429688 length of segment : 129 time for calcul the mask position with numpy : 0.0009293556213378906 nb_pixel_total : 43559 time to create 1 rle with old method : 0.051527976989746094 length of segment : 200 time for calcul the mask position with numpy : 0.0008401870727539062 nb_pixel_total : 31491 time to create 1 rle with old method : 0.03754401206970215 length of segment : 208 time for calcul the mask position with numpy : 0.022839784622192383 nb_pixel_total : 471997 time to create 1 rle with new method : 0.0292055606842041 length of segment : 919 time for calcul the mask position with numpy : 0.0006022453308105469 nb_pixel_total : 25074 time to create 1 rle with old method : 0.029490232467651367 length of segment : 142 time for calcul the mask position with numpy : 0.0006802082061767578 nb_pixel_total : 21744 time to create 1 rle with old method : 0.028751373291015625 length of segment : 161 time for calcul the mask position with numpy : 0.0019497871398925781 nb_pixel_total : 74583 time to create 1 rle with old method : 0.09349656105041504 length of segment : 309 time for calcul the mask position with numpy : 0.0009534358978271484 nb_pixel_total : 37359 time to create 1 rle with old method : 0.04448294639587402 length of segment : 253 time for calcul the mask position with numpy : 0.0009319782257080078 nb_pixel_total : 46240 time to create 1 rle with old method : 0.05545163154602051 length of segment : 208 time for calcul the mask position with numpy : 0.004716396331787109 nb_pixel_total : 78504 time to create 1 rle with old method : 0.10970163345336914 length of segment : 365 time for calcul the mask position with numpy : 0.0015554428100585938 nb_pixel_total : 53539 time to create 1 rle with old method : 0.06608915328979492 length of segment : 308 time for calcul the mask position with numpy : 0.0007555484771728516 nb_pixel_total : 21158 time to create 1 rle with old method : 0.02550673484802246 length of segment : 150 time for calcul the mask position with numpy : 0.0012934207916259766 nb_pixel_total : 40657 time to create 1 rle with old method : 0.04840826988220215 length of segment : 242 time for calcul the mask position with numpy : 0.0024547576904296875 nb_pixel_total : 86976 time to create 1 rle with old method : 0.10107064247131348 length of segment : 350 time for calcul the mask position with numpy : 0.0012850761413574219 nb_pixel_total : 54826 time to create 1 rle with old method : 0.06878232955932617 length of segment : 354 time for calcul the mask position with numpy : 0.0013885498046875 nb_pixel_total : 52072 time to create 1 rle with old method : 0.06131339073181152 length of segment : 309 time for calcul the mask position with numpy : 0.0007193088531494141 nb_pixel_total : 29949 time to create 1 rle with old method : 0.0354609489440918 length of segment : 212 time for calcul the mask position with numpy : 0.0009508132934570312 nb_pixel_total : 33059 time to create 1 rle with old method : 0.04178166389465332 length of segment : 212 time for calcul the mask position with numpy : 0.0025060176849365234 nb_pixel_total : 102926 time to create 1 rle with old method : 0.12071514129638672 length of segment : 345 time for calcul the mask position with numpy : 0.0006783008575439453 nb_pixel_total : 25702 time to create 1 rle with old method : 0.03121352195739746 length of segment : 164 time for calcul the mask position with numpy : 0.0005695819854736328 nb_pixel_total : 25561 time to create 1 rle with old method : 0.0307919979095459 length of segment : 136 time for calcul the mask position with numpy : 0.0003921985626220703 nb_pixel_total : 11027 time to create 1 rle with old method : 0.013425350189208984 length of segment : 121 time spent for convertir_results : 6.580504655838013 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 59 chid ids of type : 3594 Number RLEs to save : 16263 save missing photos in datou_result : time spend for datou_step_exec : 69.99846315383911 time spend to save output : 0.8414478302001953 total time spend for step 1 : 70.8399109840393 step2:crop_condition Sat Nov 1 09:11:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761984708_424857 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883853_0.png', 0, 597, 558, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883854_0.png', 0, 143, 407, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883856_0.png', 0, 185, 246, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883857_0.png', 0, 170, 106, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883858_0.png', 0, 193, 180, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883860_0.png', 0, 133, 180, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883865_0.png', 0, 356, 342, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883866_0.png', 0, 212, 207, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883867_0.png', 0, 253, 164, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883868_0.png', 0, 263, 182, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883869_0.png', 0, 188, 222, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883872_0.png', 0, 633, 524, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883878_0.png', 0, 99, 243, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883881_0.png', 0, 547, 333, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883887_0.png', 0, 332, 336, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883894_0.png', 0, 246, 142, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883895_0.png', 0, 189, 146, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883896_0.png', 0, 399, 308, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883899_0.png', 0, 381, 365, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883906_0.png', 0, 196, 211, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883907_0.png', 0, 289, 209, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984713), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883909_0.png', 0, 257, 146, 0, 1761984713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.496175527572632 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761984716_424857 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984717), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883862_0.png', 0, 197, 179, 0, 1761984717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984717), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883870_0.png', 0, 171, 192, 0, 1761984717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984717), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883874_0.png', 0, 186, 307, 0, 1761984717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984717), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883886_0.png', 0, 372, 209, 0, 1761984717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984717), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883897_0.png', 0, 275, 213, 0, 1761984717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984717), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883901_0.png', 0, 203, 148, 0, 1761984717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6743097305297852 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761984720_424857 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984721), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883864_0.png', 0, 265, 132, 0, 1761984721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984721), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883892_0.png', 0, 245, 207, 0, 1761984721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984721), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883910_0.png', 0, 238, 128, 0, 1761984721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984721), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883911_0.png', 0, 115, 121, 0, 1761984721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3068516254425049 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761984731_424857 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883855_0.png', 0, 218, 174, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883859_0.png', 0, 223, 287, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883861_0.png', 0, 551, 268, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883863_0.png', 0, 254, 177, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883871_0.png', 0, 273, 312, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883873_0.png', 0, 269, 300, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883877_0.png', 0, 390, 538, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883879_0.png', 0, 437, 389, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883880_0.png', 0, 406, 352, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883882_0.png', 0, 242, 434, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883885_0.png', 0, 188, 133, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883888_0.png', 0, 214, 262, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883889_0.png', 0, 267, 233, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883890_0.png', 0, 126, 129, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883891_0.png', 0, 268, 199, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883893_0.png', 0, 732, 919, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883900_0.png', 0, 301, 274, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883902_0.png', 0, 261, 220, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883903_0.png', 0, 422, 350, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883904_0.png', 0, 202, 345, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984735), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883908_0.png', 0, 385, 341, 0, 1761984735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.178325653076172 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761984739_424857 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984740), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883875_0.png', 0, 160, 91, 0, 1761984740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984740), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883876_0.png', 0, 282, 216, 0, 1761984740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984740), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503131_650a9b18cd2433b98b5b05361a0e12ca_51231966_rle_crop_4012883883_0.png', 0, 242, 189, 0, 1761984740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984740), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503131_650a9b18cd2433b98b5b05361a0e12ca_51231966_rle_crop_4012883884_0.png', 0, 252, 287, 0, 1761984740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984740), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883898_0.png', 0, 258, 196, 0, 1761984740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761984740), 0.0, 0.0, 14, '', 0, 0, '1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883905_0.png', 0, 218, 309, 0, 1761984740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.090714693069458 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1390503228, 1390503226, 1390503223, 1390503219, 1390503216, 1390503131, 1390503128, 1390503127, 1390503125, 1390503123, 1390503121, 1390503053] Looping around the photos to save general results len do output : 59 /1391559277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391559479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503228', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503226', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503223', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503219', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503216', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503131', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503128', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503127', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503125', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503123', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503121', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503053', None, None, None, None, None, '3978447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 189 time used for this insertion : 0.026367902755737305 save_final save missing photos in datou_result : time spend for datou_step_exec : 40.12875247001648 time spend to save output : 0.028849363327026367 total time spend for step 2 : 40.157601833343506 step3:rle_unique_nms_with_priority Sat Nov 1 09:12:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.3479676246643066 time for calcul the mask position with numpy : 1.5690858364105225 nb_pixel_total : 7878637 time to create 1 rle with new method : 0.3895881175994873 time for calcul the mask position with numpy : 0.03231978416442871 nb_pixel_total : 16332 time to create 1 rle with old method : 0.01896357536315918 time for calcul the mask position with numpy : 0.027132511138916016 nb_pixel_total : 57037 time to create 1 rle with old method : 0.0662224292755127 time for calcul the mask position with numpy : 0.029237985610961914 nb_pixel_total : 29530 time to create 1 rle with old method : 0.03417801856994629 time for calcul the mask position with numpy : 0.0327763557434082 nb_pixel_total : 13203 time to create 1 rle with old method : 0.015657424926757812 time for calcul the mask position with numpy : 0.034203290939331055 nb_pixel_total : 28182 time to create 1 rle with old method : 0.03800201416015625 time for calcul the mask position with numpy : 0.03389239311218262 nb_pixel_total : 28800 time to create 1 rle with old method : 0.03624272346496582 time for calcul the mask position with numpy : 0.034395694732666016 nb_pixel_total : 40916 time to create 1 rle with old method : 0.052693843841552734 time for calcul the mask position with numpy : 0.03055095672607422 nb_pixel_total : 201763 time to create 1 rle with new method : 0.4495267868041992 create new chi : 2.9920592308044434 time to delete rle : 0.021948814392089844 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6488 TO DO : save crop sub photo not yet done ! save time : 0.3696298599243164 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.453860759735107 time for calcul the mask position with numpy : 1.1659526824951172 nb_pixel_total : 8006145 time to create 1 rle with new method : 0.7550585269927979 time for calcul the mask position with numpy : 0.04890275001525879 nb_pixel_total : 38338 time to create 1 rle with old method : 0.04513239860534668 time for calcul the mask position with numpy : 0.04364466667175293 nb_pixel_total : 32309 time to create 1 rle with old method : 0.03792977333068848 time for calcul the mask position with numpy : 0.044518470764160156 nb_pixel_total : 28137 time to create 1 rle with old method : 0.032651662826538086 time for calcul the mask position with numpy : 0.034633636474609375 nb_pixel_total : 68476 time to create 1 rle with old method : 0.08345413208007812 time for calcul the mask position with numpy : 0.0417788028717041 nb_pixel_total : 24553 time to create 1 rle with old method : 0.029162168502807617 time for calcul the mask position with numpy : 0.04359841346740723 nb_pixel_total : 2883 time to create 1 rle with old method : 0.0035552978515625 time for calcul the mask position with numpy : 0.045978546142578125 nb_pixel_total : 23116 time to create 1 rle with old method : 0.04242539405822754 time for calcul the mask position with numpy : 0.04308676719665527 nb_pixel_total : 70443 time to create 1 rle with old method : 0.08189582824707031 create new chi : 2.6753273010253906 time to delete rle : 0.0018935203552246094 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 5561 TO DO : save crop sub photo not yet done ! save time : 0.34450316429138184 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.7864036560058594 time for calcul the mask position with numpy : 0.7938556671142578 nb_pixel_total : 7903791 time to create 1 rle with new method : 0.9542624950408936 time for calcul the mask position with numpy : 0.03326892852783203 nb_pixel_total : 35757 time to create 1 rle with old method : 0.041805267333984375 time for calcul the mask position with numpy : 0.026082277297973633 nb_pixel_total : 68606 time to create 1 rle with old method : 0.07831382751464844 time for calcul the mask position with numpy : 0.026326656341552734 nb_pixel_total : 179168 time to create 1 rle with new method : 0.875046968460083 time for calcul the mask position with numpy : 0.029560089111328125 nb_pixel_total : 53422 time to create 1 rle with old method : 0.07136988639831543 time for calcul the mask position with numpy : 0.03270864486694336 nb_pixel_total : 21720 time to create 1 rle with old method : 0.03592872619628906 time for calcul the mask position with numpy : 0.027735471725463867 nb_pixel_total : 31936 time to create 1 rle with old method : 0.04028129577636719 create new chi : 3.1451375484466553 time to delete rle : 0.0010616779327392578 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5918 TO DO : save crop sub photo not yet done ! save time : 0.34091973304748535 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 1.9472804069519043 time for calcul the mask position with numpy : 0.8667716979980469 nb_pixel_total : 8062021 time to create 1 rle with new method : 0.9834692478179932 time for calcul the mask position with numpy : 0.027306795120239258 nb_pixel_total : 20361 time to create 1 rle with old method : 0.028367280960083008 time for calcul the mask position with numpy : 0.04560375213623047 nb_pixel_total : 149747 time to create 1 rle with old method : 0.17455506324768066 time for calcul the mask position with numpy : 0.04343843460083008 nb_pixel_total : 51095 time to create 1 rle with old method : 0.05909228324890137 time for calcul the mask position with numpy : 0.03885245323181152 nb_pixel_total : 11176 time to create 1 rle with old method : 0.01303863525390625 create new chi : 2.338181972503662 time to delete rle : 0.0007832050323486328 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4390 TO DO : save crop sub photo not yet done ! save time : 0.24872159957885742 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.267545700073242 time for calcul the mask position with numpy : 0.8625991344451904 nb_pixel_total : 7883556 time to create 1 rle with new method : 0.46321725845336914 time for calcul the mask position with numpy : 0.03960776329040527 nb_pixel_total : 78270 time to create 1 rle with old method : 0.09313821792602539 time for calcul the mask position with numpy : 0.04275870323181152 nb_pixel_total : 106695 time to create 1 rle with old method : 0.12753820419311523 time for calcul the mask position with numpy : 0.025864839553833008 nb_pixel_total : 98856 time to create 1 rle with old method : 0.11460328102111816 time for calcul the mask position with numpy : 0.02572154998779297 nb_pixel_total : 127023 time to create 1 rle with old method : 0.14740610122680664 create new chi : 1.9909145832061768 time to delete rle : 0.0009212493896484375 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 5464 TO DO : save crop sub photo not yet done ! save time : 0.3663632869720459 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 1.4060757160186768 time for calcul the mask position with numpy : 0.49332332611083984 nb_pixel_total : 8205603 time to create 1 rle with new method : 0.7988905906677246 time for calcul the mask position with numpy : 0.02935314178466797 nb_pixel_total : 53048 time to create 1 rle with old method : 0.07692098617553711 time for calcul the mask position with numpy : 0.025311946868896484 nb_pixel_total : 35749 time to create 1 rle with old method : 0.04008984565734863 create new chi : 1.5232114791870117 time to delete rle : 0.0005981922149658203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3124 TO DO : save crop sub photo not yet done ! save time : 0.1986544132232666 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.1186716556549072 time for calcul the mask position with numpy : 0.5772747993469238 nb_pixel_total : 8103303 time to create 1 rle with new method : 0.9966473579406738 time for calcul the mask position with numpy : 0.024171113967895508 nb_pixel_total : 33231 time to create 1 rle with old method : 0.03726649284362793 time for calcul the mask position with numpy : 0.029123783111572266 nb_pixel_total : 74481 time to create 1 rle with old method : 0.08816099166870117 time for calcul the mask position with numpy : 0.027721405029296875 nb_pixel_total : 63774 time to create 1 rle with old method : 0.07073569297790527 time for calcul the mask position with numpy : 0.024483203887939453 nb_pixel_total : 19611 time to create 1 rle with old method : 0.021893739700317383 create new chi : 1.9414443969726562 time to delete rle : 0.0006411075592041016 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 4442 TO DO : save crop sub photo not yet done ! save time : 0.25138401985168457 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 1.2883353233337402 time for calcul the mask position with numpy : 0.5490167140960693 nb_pixel_total : 8191250 time to create 1 rle with new method : 0.6473333835601807 time for calcul the mask position with numpy : 0.024080514907836914 nb_pixel_total : 43559 time to create 1 rle with old method : 0.051985740661621094 time for calcul the mask position with numpy : 0.03257322311401367 nb_pixel_total : 13431 time to create 1 rle with old method : 0.018631458282470703 time for calcul the mask position with numpy : 0.02859783172607422 nb_pixel_total : 46160 time to create 1 rle with old method : 0.05247139930725098 create new chi : 1.4514751434326172 time to delete rle : 0.0005657672882080078 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3284 TO DO : save crop sub photo not yet done ! save time : 0.19679999351501465 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.470757246017456 time for calcul the mask position with numpy : 0.7021303176879883 nb_pixel_total : 7744094 time to create 1 rle with new method : 0.7959880828857422 time for calcul the mask position with numpy : 0.026949405670166016 nb_pixel_total : 21744 time to create 1 rle with old method : 0.025544404983520508 time for calcul the mask position with numpy : 0.02963733673095703 nb_pixel_total : 25074 time to create 1 rle with old method : 0.032768964767456055 time for calcul the mask position with numpy : 0.03411149978637695 nb_pixel_total : 471997 time to create 1 rle with new method : 0.6580822467803955 time for calcul the mask position with numpy : 0.02511882781982422 nb_pixel_total : 31491 time to create 1 rle with old method : 0.03625202178955078 create new chi : 2.444995641708374 time to delete rle : 0.0007925033569335938 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 5020 TO DO : save crop sub photo not yet done ! save time : 0.3261404037475586 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 1.633890151977539 time for calcul the mask position with numpy : 0.5522568225860596 nb_pixel_total : 8136218 time to create 1 rle with new method : 0.76009202003479 time for calcul the mask position with numpy : 0.024042844772338867 nb_pixel_total : 46240 time to create 1 rle with old method : 0.05489635467529297 time for calcul the mask position with numpy : 0.039408206939697266 nb_pixel_total : 37359 time to create 1 rle with old method : 0.04303479194641113 time for calcul the mask position with numpy : 0.026224851608276367 nb_pixel_total : 74583 time to create 1 rle with old method : 0.08987593650817871 create new chi : 1.6379404067993164 time to delete rle : 0.0005099773406982422 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3700 TO DO : save crop sub photo not yet done ! save time : 0.2175614833831787 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.9445855617523193 time for calcul the mask position with numpy : 0.8487763404846191 nb_pixel_total : 7876719 time to create 1 rle with new method : 0.4944627285003662 time for calcul the mask position with numpy : 0.03737282752990723 nb_pixel_total : 29949 time to create 1 rle with old method : 0.03409576416015625 time for calcul the mask position with numpy : 0.02383732795715332 nb_pixel_total : 52072 time to create 1 rle with old method : 0.058507680892944336 time for calcul the mask position with numpy : 0.02399587631225586 nb_pixel_total : 54826 time to create 1 rle with old method : 0.06042647361755371 time for calcul the mask position with numpy : 0.02456831932067871 nb_pixel_total : 86976 time to create 1 rle with old method : 0.09603071212768555 time for calcul the mask position with numpy : 0.024099349975585938 nb_pixel_total : 40657 time to create 1 rle with old method : 0.045839786529541016 time for calcul the mask position with numpy : 0.028988361358642578 nb_pixel_total : 21158 time to create 1 rle with old method : 0.023250102996826172 time for calcul the mask position with numpy : 0.02701711654663086 nb_pixel_total : 53539 time to create 1 rle with old method : 0.05862164497375488 time for calcul the mask position with numpy : 0.026047229766845703 nb_pixel_total : 78504 time to create 1 rle with old method : 0.08658909797668457 create new chi : 2.0686252117156982 time to delete rle : 0.001420736312866211 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 6740 TO DO : save crop sub photo not yet done ! save time : 0.38164186477661133 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.298379898071289 time for calcul the mask position with numpy : 0.3762085437774658 nb_pixel_total : 8096125 time to create 1 rle with new method : 0.8934109210968018 time for calcul the mask position with numpy : 0.02443981170654297 nb_pixel_total : 11027 time to create 1 rle with old method : 0.012892961502075195 time for calcul the mask position with numpy : 0.025829315185546875 nb_pixel_total : 25561 time to create 1 rle with old method : 0.02972698211669922 time for calcul the mask position with numpy : 0.026674270629882812 nb_pixel_total : 25702 time to create 1 rle with old method : 0.030047893524169922 time for calcul the mask position with numpy : 0.025838136672973633 nb_pixel_total : 102926 time to create 1 rle with old method : 0.11993765830993652 time for calcul the mask position with numpy : 0.02445387840270996 nb_pixel_total : 33059 time to create 1 rle with old method : 0.03907608985900879 create new chi : 1.6781244277954102 time to delete rle : 0.0006632804870605469 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4116 TO DO : save crop sub photo not yet done ! save time : 0.26523470878601074 map_output_result : {1390503228: (0.0, 'Should be the crop_list due to order', 0), 1390503226: (0.0, 'Should be the crop_list due to order', 0), 1390503223: (0.0, 'Should be the crop_list due to order', 0), 1390503219: (0.0, 'Should be the crop_list due to order', 0), 1390503216: (0.0, 'Should be the crop_list due to order', 0), 1390503131: (0.0, 'Should be the crop_list due to order', 0), 1390503128: (0.0, 'Should be the crop_list due to order', 0), 1390503127: (0.0, 'Should be the crop_list due to order', 0), 1390503125: (0.0, 'Should be the crop_list due to order', 0), 1390503123: (0.0, 'Should be the crop_list due to order', 0), 1390503121: (0.0, 'Should be the crop_list due to order', 0), 1390503053: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1390503228, 1390503226, 1390503223, 1390503219, 1390503216, 1390503131, 1390503128, 1390503127, 1390503125, 1390503123, 1390503121, 1390503053] Looping around the photos to save general results len do output : 12 /1390503228.Didn't retrieve data . /1390503226.Didn't retrieve data . /1390503223.Didn't retrieve data . /1390503219.Didn't retrieve data . /1390503216.Didn't retrieve data . /1390503131.Didn't retrieve data . /1390503128.Didn't retrieve data . /1390503127.Didn't retrieve data . /1390503125.Didn't retrieve data . /1390503123.Didn't retrieve data . /1390503121.Didn't retrieve data . /1390503053.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503228', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503226', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503223', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503219', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503216', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503131', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503128', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503127', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503125', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503123', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503121', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503053', None, None, None, None, None, '3978447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.013178586959838867 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.37727093696594 time spend to save output : 0.013638019561767578 total time spend for step 3 : 61.39090895652771 step4:ventilate_hashtags_in_portfolio Sat Nov 1 09:13:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28056036 get user id for portfolio 28056036 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056036 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','flou','background','pet_clair','carton','metal','pet_fonce','environnement','autre','papier','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056036 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','flou','background','pet_clair','carton','metal','pet_fonce','environnement','autre','papier','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056036 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','flou','background','pet_clair','carton','metal','pet_fonce','environnement','autre','papier','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28056928,28056929,28056930,28056931,28056932,28056933,28056934,28056935,28056936,28056937,28056938?tags=pehd,flou,background,pet_clair,carton,metal,pet_fonce,environnement,autre,papier,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1390503228, 1390503226, 1390503223, 1390503219, 1390503216, 1390503131, 1390503128, 1390503127, 1390503125, 1390503123, 1390503121, 1390503053] Looping around the photos to save general results len do output : 1 /28056036. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503228', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503226', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503223', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503219', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503216', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503131', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503128', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503127', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503125', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503123', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503121', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503053', None, None, None, None, None, '3978447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.012653589248657227 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6604816913604736 time spend to save output : 0.012893438339233398 total time spend for step 4 : 1.673375129699707 step5:final Sat Nov 1 09:13:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1390503228: ('0.03461510175540124',), 1390503226: ('0.03461510175540124',), 1390503223: ('0.03461510175540124',), 1390503219: ('0.03461510175540124',), 1390503216: ('0.03461510175540124',), 1390503131: ('0.03461510175540124',), 1390503128: ('0.03461510175540124',), 1390503127: ('0.03461510175540124',), 1390503125: ('0.03461510175540124',), 1390503123: ('0.03461510175540124',), 1390503121: ('0.03461510175540124',), 1390503053: ('0.03461510175540124',)} new output for save of step final : {1390503228: ('0.03461510175540124',), 1390503226: ('0.03461510175540124',), 1390503223: ('0.03461510175540124',), 1390503219: ('0.03461510175540124',), 1390503216: ('0.03461510175540124',), 1390503131: ('0.03461510175540124',), 1390503128: ('0.03461510175540124',), 1390503127: ('0.03461510175540124',), 1390503125: ('0.03461510175540124',), 1390503123: ('0.03461510175540124',), 1390503121: ('0.03461510175540124',), 1390503053: ('0.03461510175540124',)} [1390503228, 1390503226, 1390503223, 1390503219, 1390503216, 1390503131, 1390503128, 1390503127, 1390503125, 1390503123, 1390503121, 1390503053] Looping around the photos to save general results len do output : 12 /1390503228.Didn't retrieve data . /1390503226.Didn't retrieve data . /1390503223.Didn't retrieve data . /1390503219.Didn't retrieve data . /1390503216.Didn't retrieve data . /1390503131.Didn't retrieve data . /1390503128.Didn't retrieve data . /1390503127.Didn't retrieve data . /1390503125.Didn't retrieve data . /1390503123.Didn't retrieve data . /1390503121.Didn't retrieve data . /1390503053.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503228', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503226', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503223', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503219', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503216', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503131', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503128', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503127', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503125', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503123', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503121', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503053', None, None, None, None, None, '3978447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.01154327392578125 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11964821815490723 time spend to save output : 0.0119171142578125 total time spend for step 5 : 0.13156533241271973 step6:blur_detection Sat Nov 1 09:13:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868.jpg resize: (2160, 3840) 1390503228 -6.482042616406264 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997.jpg resize: (2160, 3840) 1390503226 -6.0466951901320884 treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742.jpg resize: (2160, 3840) 1390503223 -6.80831221507479 treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453.jpg resize: (2160, 3840) 1390503219 -6.787509067770606 treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066.jpg resize: (2160, 3840) 1390503216 -6.290179532706719 treat image : temp/1761984627_424857_1390503131_650a9b18cd2433b98b5b05361a0e12ca_51231966.jpg resize: (2160, 3840) 1390503131 -6.931685277298126 treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693.jpg resize: (2160, 3840) 1390503128 -6.8797506011557665 treat image : temp/1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716.jpg resize: (2160, 3840) 1390503127 -6.674384453689135 treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872.jpg resize: (2160, 3840) 1390503125 -6.896227713773323 treat image : temp/1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523.jpg resize: (2160, 3840) 1390503123 -6.87355173717961 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258.jpg resize: (2160, 3840) 1390503121 -6.950444041574551 treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967.jpg resize: (2160, 3840) 1390503053 -6.2425141762323735 treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883853_0.png resize: (558, 597) 1391559277 -3.7995268467938907 treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883854_0.png resize: (407, 143) 1391559278 -4.251942496119629 treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883856_0.png resize: (246, 185) 1391559279 -4.497736736261631 treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883857_0.png resize: (106, 170) 1391559280 -4.034528664190274 treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883858_0.png resize: (180, 193) 1391559283 -3.5080272048321213 treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883860_0.png resize: (180, 133) 1391559284 -4.090206713126017 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883865_0.png resize: (342, 356) 1391559285 -4.450364513896717 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883866_0.png resize: (207, 212) 1391559287 -3.653972035152614 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883867_0.png resize: (164, 253) 1391559289 -3.047623577122045 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883868_0.png resize: (182, 263) 1391559290 -4.697229210053643 treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883869_0.png resize: (222, 188) 1391559291 -4.712319562569217 treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883872_0.png resize: (524, 633) 1391559293 -5.170621118486157 treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883878_0.png resize: (243, 99) 1391559295 -4.775690155970205 treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883881_0.png resize: (333, 547) 1391559296 -4.33410003711448 treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883887_0.png resize: (336, 332) 1391559297 -4.465068767070661 treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883894_0.png resize: (142, 246) 1391559299 -4.7456830298162505 treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883895_0.png resize: (146, 189) 1391559301 -3.982709588667903 treat image : temp/1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883896_0.png resize: (308, 399) 1391559302 -4.395131681880894 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883899_0.png resize: (365, 381) 1391559303 -4.378929544669005 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883906_0.png resize: (211, 196) 1391559305 -4.162578957802624 treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883907_0.png resize: (209, 289) 1391559307 -4.534775681953579 treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883909_0.png resize: (146, 257) 1391559308 -4.171795979488432 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883862_0.png resize: (179, 197) 1391559359 -3.8212726390881366 treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883870_0.png resize: (192, 171) 1391559360 -2.7249151778067557 treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883874_0.png resize: (307, 186) 1391559362 -4.617998497659923 treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883886_0.png resize: (209, 372) 1391559363 -3.0173556622916853 treat image : temp/1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883897_0.png resize: (213, 275) 1391559364 -3.1476938081883175 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883901_0.png resize: (148, 203) 1391559365 -2.3052647036091454 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883864_0.png resize: (132, 265) 1391559393 -4.059939896283899 treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883892_0.png resize: (207, 245) 1391559394 -4.50638137664615 treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883910_0.png resize: (128, 238) 1391559395 -4.340751691749491 treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883911_0.png resize: (121, 115) 1391559397 -5.053845871461547 treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883855_0.png resize: (174, 218) 1391559451 -4.560856764967402 treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883859_0.png resize: (287, 223) 1391559452 -3.0549691007239477 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883861_0.png resize: (268, 551) 1391559453 -3.4497690668275984 treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883863_0.png resize: (177, 254) 1391559454 -4.689855417404332 treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883871_0.png resize: (312, 273) 1391559455 -4.49506205632182 treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883873_0.png resize: (300, 269) 1391559456 -2.419226983411486 treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883877_0.png resize: (538, 390) 1391559457 -4.822530100799492 treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883879_0.png resize: (389, 437) 1391559458 -6.029721159192497 treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883880_0.png resize: (352, 406) 1391559459 -3.6210084344063427 treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883882_0.png resize: (434, 242) 1391559460 -2.754588547855045 treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883885_0.png resize: (133, 188) 1391559461 -4.50139620842842 treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883888_0.png resize: (262, 214) 1391559462 -4.111281739339037 treat image : temp/1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883889_0.png resize: (233, 267) 1391559463 -3.6180815008923957 treat image : temp/1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883890_0.png resize: (129, 126) 1391559464 -3.7263280741739853 treat image : temp/1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883891_0.png resize: (199, 268) 1391559465 -5.091701953566079 treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883893_0.png resize: (919, 732) 1391559466 -5.243704670942016 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883900_0.png resize: (274, 301) 1391559467 -4.373776396345902 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883902_0.png resize: (220, 261) 1391559468 -4.125728677691283 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883903_0.png resize: (350, 422) 1391559469 -4.0811439757963885 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883904_0.png resize: (345, 202) 1391559470 -4.762090176908003 treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883908_0.png resize: (341, 385) 1391559471 -5.5916070393208885 treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883875_0.png resize: (91, 160) 1391559474 -4.165802457206662 treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883876_0.png resize: (216, 282) 1391559475 -6.040212116046971 treat image : temp/1761984627_424857_1390503131_650a9b18cd2433b98b5b05361a0e12ca_51231966_rle_crop_4012883883_0.png resize: (189, 242) 1391559476 -5.235934202171655 treat image : temp/1761984627_424857_1390503131_650a9b18cd2433b98b5b05361a0e12ca_51231966_rle_crop_4012883884_0.png resize: (287, 252) 1391559477 -3.5359267596433424 treat image : temp/1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883898_0.png resize: (196, 258) 1391559478 -4.793686897000522 treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883905_0.png resize: (309, 218) 1391559479 -5.36443958440761 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 71 time used for this insertion : 0.014347314834594727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 71 time used for this insertion : 0.01383209228515625 save missing photos in datou_result : time spend for datou_step_exec : 49.433868169784546 time spend to save output : 0.03347325325012207 total time spend for step 6 : 49.46734142303467 step7:brightness Sat Nov 1 09:14:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868.jpg treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997.jpg treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742.jpg treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453.jpg treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066.jpg treat image : temp/1761984627_424857_1390503131_650a9b18cd2433b98b5b05361a0e12ca_51231966.jpg treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693.jpg treat image : temp/1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716.jpg treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872.jpg treat image : temp/1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523.jpg treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258.jpg treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967.jpg treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883853_0.png treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883854_0.png treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883856_0.png treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883857_0.png treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883858_0.png treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883860_0.png treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883865_0.png treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883866_0.png treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883867_0.png treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883868_0.png treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883869_0.png treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883872_0.png treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883878_0.png treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883881_0.png treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883887_0.png treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883894_0.png treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883895_0.png treat image : temp/1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883896_0.png treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883899_0.png treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883906_0.png treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883907_0.png treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883909_0.png treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883862_0.png treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883870_0.png treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883874_0.png treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883886_0.png treat image : temp/1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883897_0.png treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883901_0.png treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883864_0.png treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883892_0.png treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883910_0.png treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883911_0.png treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883855_0.png treat image : temp/1761984627_424857_1390503228_68f48d559ed1de0c9e74cf675773a9c6_57932868_rle_crop_4012883859_0.png treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883861_0.png treat image : temp/1761984627_424857_1390503226_4833670d6b971f166898aebd286ef451_17094997_rle_crop_4012883863_0.png treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883871_0.png treat image : temp/1761984627_424857_1390503223_db470a669b5ef836ec690d9449e2e9cd_24508742_rle_crop_4012883873_0.png treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883877_0.png treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883879_0.png treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883880_0.png treat image : temp/1761984627_424857_1390503216_35c0a8c12694e8d7f4938f0e4ac4ffbf_14765066_rle_crop_4012883882_0.png treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883885_0.png treat image : temp/1761984627_424857_1390503128_a33e90f96d81ee3bd2885d7c16f38d0d_63491693_rle_crop_4012883888_0.png treat image : temp/1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883889_0.png treat image : temp/1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883890_0.png treat image : temp/1761984627_424857_1390503127_6e963b104bd224066379cf4dad8d9d03_83227716_rle_crop_4012883891_0.png treat image : temp/1761984627_424857_1390503125_2753297acce51a7508703b3226c56cee_71103872_rle_crop_4012883893_0.png treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883900_0.png treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883902_0.png treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883903_0.png treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883904_0.png treat image : temp/1761984627_424857_1390503053_b68a257fcecf88585bd6706471626a7c_50413967_rle_crop_4012883908_0.png treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883875_0.png treat image : temp/1761984627_424857_1390503219_70b7a9f0255cbc1733e69feb05029692_68846453_rle_crop_4012883876_0.png treat image : temp/1761984627_424857_1390503131_650a9b18cd2433b98b5b05361a0e12ca_51231966_rle_crop_4012883883_0.png treat image : temp/1761984627_424857_1390503131_650a9b18cd2433b98b5b05361a0e12ca_51231966_rle_crop_4012883884_0.png treat image : temp/1761984627_424857_1390503123_d7a6f595d7c78f0c11055d42197ec558_15824523_rle_crop_4012883898_0.png treat image : temp/1761984627_424857_1390503121_627501e14e9cbc93e6da29ac306ed64c_89964258_rle_crop_4012883905_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 71 time used for this insertion : 0.01199793815612793 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 71 time used for this insertion : 0.015908479690551758 save missing photos in datou_result : time spend for datou_step_exec : 14.08805537223816 time spend to save output : 0.03357219696044922 total time spend for step 7 : 14.121627569198608 step8:velours_tree Sat Nov 1 09:14:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14626836776733398 time spend to save output : 5.602836608886719e-05 total time spend for step 8 : 0.14632439613342285 step9:send_mail_cod Sat Nov 1 09:14:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28056036_01-11-2025_09_14_27.pdf 28056928 imagette280569281761984867 28056929 imagette280569291761984867 28056930 imagette280569301761984867 28056931 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280569311761984867 28056932 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280569321761984869 28056933 change filename to text .change filename to text .change filename to text .change filename to text .imagette280569331761984870 28056934 imagette280569341761984870 28056936 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280569361761984870 28056937 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280569371761984871 28056938 imagette280569381761984873 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28056036 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28056928,28056929,28056930,28056931,28056932,28056933,28056934,28056935,28056936,28056937,28056938?tags=pehd,flou,background,pet_clair,carton,metal,pet_fonce,environnement,autre,papier,mal_croppe args[1390503228] : ((1390503228, -6.482042616406264, 492609224), (1390503228, -0.2733213691041915, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503226] : ((1390503226, -6.0466951901320884, 492609224), (1390503226, -0.7397349211513874, 501862349), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503223] : ((1390503223, -6.80831221507479, 492609224), (1390503223, -0.2963406186620356, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503219] : ((1390503219, -6.787509067770606, 492609224), (1390503219, -0.35257997482420705, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503216] : ((1390503216, -6.290179532706719, 492609224), (1390503216, -0.2970948646180777, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503131] : ((1390503131, -6.931685277298126, 492609224), (1390503131, -0.4182456864345055, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503128] : ((1390503128, -6.8797506011557665, 492609224), (1390503128, -0.22283533445274933, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503127] : ((1390503127, -6.674384453689135, 492609224), (1390503127, -0.2890250925206017, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503125] : ((1390503125, -6.896227713773323, 492609224), (1390503125, -0.15559007409933606, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503123] : ((1390503123, -6.87355173717961, 492609224), (1390503123, -0.33214953218506066, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503121] : ((1390503121, -6.950444041574551, 492609224), (1390503121, -0.30284963213703187, 496442774), '0.03461510175540124') We are sending mail with results at report@fotonower.com args[1390503053] : ((1390503053, -6.2425141762323735, 492609224), (1390503053, -0.7962925223244142, 501862349), '0.03461510175540124') We are sending mail with results at report@fotonower.com refus_total : 0.03461510175540124 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28056036 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056036_01-11-2025_09_14_27.pdf results_Auto_P28056036_01-11-2025_09_14_27.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056036_01-11-2025_09_14_27.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28056036','results_Auto_P28056036_01-11-2025_09_14_27.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056036_01-11-2025_09_14_27.pdf','pdf','','0.8','0.03461510175540124') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28056036

https://www.fotonower.com/image?json=false&list_photos_id=1390503228
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503226
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503223
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503219
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503216
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503131
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503128
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503127
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503125
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503123
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503121
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390503053
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 3.46%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/28056931?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28056932?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28056933?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28056936?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28056937?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056036_01-11-2025_09_14_27.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28056928,28056929,28056930,28056931,28056932,28056933,28056934,28056935,28056936,28056937,28056938?tags=pehd,flou,background,pet_clair,carton,metal,pet_fonce,environnement,autre,papier,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Sat, 01 Nov 2025 08:14:36 GMT Content-Length: 0 Connection: close X-Message-Id: zLSiJYTvR8yMJ9k1O9YXmA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1390503228, 1390503226, 1390503223, 1390503219, 1390503216, 1390503131, 1390503128, 1390503127, 1390503125, 1390503123, 1390503121, 1390503053] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503228', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503226', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503223', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503219', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503216', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503131', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503128', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503127', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503125', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503123', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503121', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503053', None, None, None, None, None, '3978447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.011220932006835938 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.689087867736816 time spend to save output : 0.011502981185913086 total time spend for step 9 : 8.70059084892273 step10:split_time_score Sat Nov 1 09:14:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27102025 28056036 Nombre de photos uploadées : 12 / 23040 (0%) 27102025 28056036 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 27102025 28056036 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006279945373535156 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20805692672729492 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28055805 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28055847 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28055879 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28055888 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28055890 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28055937 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28055969 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28055984 order by id desc limit 1 Qualite : 0.03461510175540124 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056036_01-11-2025_09_14_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28056036 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056036 AND mptpi.`type`=3594 To do Qualite : 0.02779737479820457 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056070_01-11-2025_09_13_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28056070 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056070 AND mptpi.`type`=3726 To do Qualite : 0.0567253390263973 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056130_01-11-2025_09_07_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28056130 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056130 AND mptpi.`type`=3726 To do Qualite : 0.021511983989197528 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056172_01-11-2025_09_03_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28056172 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056172 AND mptpi.`type`=3594 To do Qualite : 0.05237429002240157 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056181_01-11-2025_09_07_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28056181 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056181 AND mptpi.`type`=3726 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056184_01-11-2025_09_01_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28056184 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056184 AND mptpi.`type`=3726 To do Qualite : 0.11163449593537282 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28056188_01-11-2025_08_58_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28056188 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28056188 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27102025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1390503228, 1390503226, 1390503223, 1390503219, 1390503216, 1390503131, 1390503128, 1390503127, 1390503125, 1390503123, 1390503121, 1390503053] Looping around the photos to save general results len do output : 1 /28056036Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503228', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503226', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503223', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503219', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503216', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503131', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503128', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503127', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503125', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503123', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503121', None, None, None, None, None, '3978447') ('3318', None, None, None, None, None, None, None, '3978447') ('3318', '28056036', '1390503053', None, None, None, None, None, '3978447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.010769128799438477 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.50548267364502 time spend to save output : 0.011052846908569336 total time spend for step 10 : 12.516535520553589 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 118.84user 107.39system 4:24.09elapsed 85%CPU (0avgtext+0avgdata 4448868maxresident)k 751592inputs+104272outputs (7122major+10471788minor)pagefaults 0swaps