python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2058459 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3903287'] with mtr_portfolio_ids : ['27642741'] and first list_photo_ids : [] new path : /proc/2058459/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.918581962585449 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Oct 9 12:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4361 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-09 12:40:34.652166: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-09 12:40:34.686445: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-09 12:40:34.689318: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fae0c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-09 12:40:34.689348: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-09 12:40:34.693448: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-09 12:40:34.961398: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x184d2b50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-09 12:40:34.961467: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-09 12:40:34.963137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-09 12:40:34.964009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-09 12:40:34.968133: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-09 12:40:34.987407: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-09 12:40:34.989317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-09 12:40:35.020157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-09 12:40:35.022593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-09 12:40:35.079883: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-09 12:40:35.081443: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-09 12:40:35.081938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-09 12:40:35.082728: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-09 12:40:35.082750: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-09 12:40:35.082762: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-09 12:40:35.084056: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3909 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-09 12:40:35.535330: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-09 12:40:35.535454: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-09 12:40:35.535477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-09 12:40:35.535498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-09 12:40:35.535517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-09 12:40:35.535536: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-09 12:40:35.535556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-09 12:40:35.535575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-09 12:40:35.536771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-09 12:40:35.538194: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-09 12:40:35.538236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-09 12:40:35.538260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-09 12:40:35.538314: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-09 12:40:35.538341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-09 12:40:35.538363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-09 12:40:35.538384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-09 12:40:35.538405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-09 12:40:35.539468: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-09 12:40:35.539508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-09 12:40:35.539516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-09 12:40:35.539523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-09 12:40:35.540404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3909 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-09 12:40:45.502688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-09 12:40:45.676178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-09 12:40:47.644040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:47.644680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3207580672 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.564544: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-10-09 12:40:48.641460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.641564: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.645273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.645299: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.651875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.651904: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.652761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.652781: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.683858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.683924: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.683955: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-09 12:40:48.685031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.685058: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.686118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.686145: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.692943: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.692961: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.693538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.693553: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.694138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.694152: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:40:48.694733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.703223: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.704161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.724140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.724946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.725749: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.726551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.731500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.732145: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.732758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.733340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.734284: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.746460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.747098: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.757057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.757684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.758288: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.758921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.759562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:40:48.760194: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 2059109 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2001 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3194 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0036313533782958984 nb_pixel_total : 111264 time to create 1 rle with old method : 0.13066935539245605 length of segment : 528 time for calcul the mask position with numpy : 0.0013899803161621094 nb_pixel_total : 61208 time to create 1 rle with old method : 0.07044482231140137 length of segment : 329 time for calcul the mask position with numpy : 0.000171661376953125 nb_pixel_total : 10111 time to create 1 rle with old method : 0.011934041976928711 length of segment : 127 time for calcul the mask position with numpy : 0.0012352466583251953 nb_pixel_total : 81029 time to create 1 rle with old method : 0.10000920295715332 length of segment : 302 time for calcul the mask position with numpy : 0.004067182540893555 nb_pixel_total : 170025 time to create 1 rle with new method : 0.00893855094909668 length of segment : 451 time for calcul the mask position with numpy : 0.0002446174621582031 nb_pixel_total : 8439 time to create 1 rle with old method : 0.010633468627929688 length of segment : 203 time for calcul the mask position with numpy : 0.0004885196685791016 nb_pixel_total : 21928 time to create 1 rle with old method : 0.025905370712280273 length of segment : 188 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 14841 time to create 1 rle with old method : 0.01780557632446289 length of segment : 134 time for calcul the mask position with numpy : 0.0006029605865478516 nb_pixel_total : 38894 time to create 1 rle with old method : 0.04588890075683594 length of segment : 238 time for calcul the mask position with numpy : 0.0018334388732910156 nb_pixel_total : 68774 time to create 1 rle with old method : 0.09700775146484375 length of segment : 370 time for calcul the mask position with numpy : 0.00215911865234375 nb_pixel_total : 98950 time to create 1 rle with old method : 0.12441563606262207 length of segment : 373 time for calcul the mask position with numpy : 0.0021398067474365234 nb_pixel_total : 133129 time to create 1 rle with old method : 0.15348219871520996 length of segment : 436 time for calcul the mask position with numpy : 0.0004544258117675781 nb_pixel_total : 13371 time to create 1 rle with old method : 0.016231536865234375 length of segment : 150 time for calcul the mask position with numpy : 0.0008292198181152344 nb_pixel_total : 31689 time to create 1 rle with old method : 0.038005828857421875 length of segment : 218 time for calcul the mask position with numpy : 0.00017833709716796875 nb_pixel_total : 7611 time to create 1 rle with old method : 0.00922393798828125 length of segment : 113 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 21998 time to create 1 rle with old method : 0.026152849197387695 length of segment : 124 time for calcul the mask position with numpy : 0.0004360675811767578 nb_pixel_total : 17465 time to create 1 rle with old method : 0.020778894424438477 length of segment : 252 time for calcul the mask position with numpy : 0.0017392635345458984 nb_pixel_total : 80613 time to create 1 rle with old method : 0.09482693672180176 length of segment : 401 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 17088 time to create 1 rle with old method : 0.020754098892211914 length of segment : 92 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 33786 time to create 1 rle with old method : 0.039128780364990234 length of segment : 270 time for calcul the mask position with numpy : 0.0020618438720703125 nb_pixel_total : 135405 time to create 1 rle with old method : 0.1548621654510498 length of segment : 355 time for calcul the mask position with numpy : 0.004449605941772461 nb_pixel_total : 183540 time to create 1 rle with new method : 0.010598182678222656 length of segment : 597 time for calcul the mask position with numpy : 0.0012009143829345703 nb_pixel_total : 68113 time to create 1 rle with old method : 0.07970952987670898 length of segment : 388 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 10755 time to create 1 rle with old method : 0.013010740280151367 length of segment : 142 time for calcul the mask position with numpy : 0.0005421638488769531 nb_pixel_total : 27784 time to create 1 rle with old method : 0.03340625762939453 length of segment : 208 time for calcul the mask position with numpy : 0.0007691383361816406 nb_pixel_total : 49633 time to create 1 rle with old method : 0.06787824630737305 length of segment : 353 time for calcul the mask position with numpy : 0.001035928726196289 nb_pixel_total : 42415 time to create 1 rle with old method : 0.050809621810913086 length of segment : 263 time for calcul the mask position with numpy : 0.00029659271240234375 nb_pixel_total : 13474 time to create 1 rle with old method : 0.02088642120361328 length of segment : 177 time for calcul the mask position with numpy : 0.0003325939178466797 nb_pixel_total : 22201 time to create 1 rle with old method : 0.026662111282348633 length of segment : 126 time for calcul the mask position with numpy : 0.0012843608856201172 nb_pixel_total : 65997 time to create 1 rle with old method : 0.07738876342773438 length of segment : 482 time for calcul the mask position with numpy : 0.0003523826599121094 nb_pixel_total : 22058 time to create 1 rle with old method : 0.026868343353271484 length of segment : 173 time for calcul the mask position with numpy : 0.0018298625946044922 nb_pixel_total : 137299 time to create 1 rle with old method : 0.16567683219909668 length of segment : 671 time for calcul the mask position with numpy : 0.002538919448852539 nb_pixel_total : 173829 time to create 1 rle with new method : 0.013532400131225586 length of segment : 620 time for calcul the mask position with numpy : 0.0002949237823486328 nb_pixel_total : 12368 time to create 1 rle with old method : 0.014283895492553711 length of segment : 177 time for calcul the mask position with numpy : 0.00045990943908691406 nb_pixel_total : 26752 time to create 1 rle with old method : 0.03249168395996094 length of segment : 197 time for calcul the mask position with numpy : 0.0014271736145019531 nb_pixel_total : 89582 time to create 1 rle with old method : 0.11129570007324219 length of segment : 564 time for calcul the mask position with numpy : 0.0006961822509765625 nb_pixel_total : 31839 time to create 1 rle with old method : 0.038245201110839844 length of segment : 355 time for calcul the mask position with numpy : 0.0016336441040039062 nb_pixel_total : 50532 time to create 1 rle with old method : 0.06052088737487793 length of segment : 474 time for calcul the mask position with numpy : 0.007477521896362305 nb_pixel_total : 250609 time to create 1 rle with new method : 0.014348268508911133 length of segment : 632 time for calcul the mask position with numpy : 0.0012271404266357422 nb_pixel_total : 49563 time to create 1 rle with old method : 0.05907773971557617 length of segment : 208 time for calcul the mask position with numpy : 0.0008614063262939453 nb_pixel_total : 31110 time to create 1 rle with old method : 0.057395219802856445 length of segment : 242 time for calcul the mask position with numpy : 0.002648591995239258 nb_pixel_total : 41469 time to create 1 rle with old method : 0.04904890060424805 length of segment : 443 time for calcul the mask position with numpy : 0.0028176307678222656 nb_pixel_total : 141732 time to create 1 rle with old method : 0.19086337089538574 length of segment : 270 time for calcul the mask position with numpy : 0.001954793930053711 nb_pixel_total : 61791 time to create 1 rle with old method : 0.07068896293640137 length of segment : 286 time for calcul the mask position with numpy : 0.0007646083831787109 nb_pixel_total : 26179 time to create 1 rle with old method : 0.046370506286621094 length of segment : 133 time for calcul the mask position with numpy : 0.0005970001220703125 nb_pixel_total : 19660 time to create 1 rle with old method : 0.02403092384338379 length of segment : 140 time for calcul the mask position with numpy : 0.0013434886932373047 nb_pixel_total : 26122 time to create 1 rle with old method : 0.03167843818664551 length of segment : 315 time for calcul the mask position with numpy : 0.0004169940948486328 nb_pixel_total : 9437 time to create 1 rle with old method : 0.011686563491821289 length of segment : 94 time for calcul the mask position with numpy : 0.000591278076171875 nb_pixel_total : 14837 time to create 1 rle with old method : 0.017389774322509766 length of segment : 166 time for calcul the mask position with numpy : 0.0009114742279052734 nb_pixel_total : 26571 time to create 1 rle with old method : 0.03150486946105957 length of segment : 205 time for calcul the mask position with numpy : 0.0014641284942626953 nb_pixel_total : 45574 time to create 1 rle with old method : 0.05326128005981445 length of segment : 175 time for calcul the mask position with numpy : 0.0003800392150878906 nb_pixel_total : 9487 time to create 1 rle with old method : 0.011195182800292969 length of segment : 119 time for calcul the mask position with numpy : 0.002476930618286133 nb_pixel_total : 64634 time to create 1 rle with old method : 0.07863759994506836 length of segment : 319 time for calcul the mask position with numpy : 0.0008246898651123047 nb_pixel_total : 17630 time to create 1 rle with old method : 0.02158641815185547 length of segment : 129 time for calcul the mask position with numpy : 0.0004334449768066406 nb_pixel_total : 10599 time to create 1 rle with old method : 0.01315164566040039 length of segment : 83 time for calcul the mask position with numpy : 0.0013167858123779297 nb_pixel_total : 37335 time to create 1 rle with old method : 0.04490208625793457 length of segment : 278 time for calcul the mask position with numpy : 0.0009450912475585938 nb_pixel_total : 21703 time to create 1 rle with old method : 0.02594590187072754 length of segment : 269 time for calcul the mask position with numpy : 0.0008511543273925781 nb_pixel_total : 25050 time to create 1 rle with old method : 0.029500961303710938 length of segment : 162 time for calcul the mask position with numpy : 0.004617929458618164 nb_pixel_total : 123421 time to create 1 rle with old method : 0.17211103439331055 length of segment : 691 time for calcul the mask position with numpy : 0.0013844966888427734 nb_pixel_total : 46363 time to create 1 rle with old method : 0.05561518669128418 length of segment : 211 time for calcul the mask position with numpy : 0.0006797313690185547 nb_pixel_total : 7317 time to create 1 rle with old method : 0.012627124786376953 length of segment : 167 time for calcul the mask position with numpy : 0.003245830535888672 nb_pixel_total : 81589 time to create 1 rle with old method : 0.11403155326843262 length of segment : 489 time for calcul the mask position with numpy : 0.0010714530944824219 nb_pixel_total : 43702 time to create 1 rle with old method : 0.05101728439331055 length of segment : 272 time for calcul the mask position with numpy : 0.008608341217041016 nb_pixel_total : 167427 time to create 1 rle with new method : 0.04136037826538086 length of segment : 588 time for calcul the mask position with numpy : 0.0014760494232177734 nb_pixel_total : 24640 time to create 1 rle with old method : 0.02868819236755371 length of segment : 272 time for calcul the mask position with numpy : 0.0015647411346435547 nb_pixel_total : 44024 time to create 1 rle with old method : 0.05074620246887207 length of segment : 254 time for calcul the mask position with numpy : 0.0005035400390625 nb_pixel_total : 12618 time to create 1 rle with old method : 0.01534128189086914 length of segment : 127 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 12652 time to create 1 rle with old method : 0.015401124954223633 length of segment : 133 time for calcul the mask position with numpy : 0.002969980239868164 nb_pixel_total : 92463 time to create 1 rle with old method : 0.11196637153625488 length of segment : 363 time for calcul the mask position with numpy : 0.002845287322998047 nb_pixel_total : 73481 time to create 1 rle with old method : 0.08644986152648926 length of segment : 644 time for calcul the mask position with numpy : 0.0016849040985107422 nb_pixel_total : 38134 time to create 1 rle with old method : 0.04351401329040527 length of segment : 306 time for calcul the mask position with numpy : 0.001260519027709961 nb_pixel_total : 42092 time to create 1 rle with old method : 0.04974961280822754 length of segment : 375 time for calcul the mask position with numpy : 0.0014154911041259766 nb_pixel_total : 38321 time to create 1 rle with old method : 0.04556846618652344 length of segment : 315 time for calcul the mask position with numpy : 0.000988006591796875 nb_pixel_total : 27527 time to create 1 rle with old method : 0.033449649810791016 length of segment : 221 time for calcul the mask position with numpy : 0.007203817367553711 nb_pixel_total : 258947 time to create 1 rle with new method : 0.014989137649536133 length of segment : 591 time for calcul the mask position with numpy : 0.0020287036895751953 nb_pixel_total : 59899 time to create 1 rle with old method : 0.0707085132598877 length of segment : 377 time for calcul the mask position with numpy : 0.0004830360412597656 nb_pixel_total : 20202 time to create 1 rle with old method : 0.02409052848815918 length of segment : 235 time for calcul the mask position with numpy : 0.0006425380706787109 nb_pixel_total : 27635 time to create 1 rle with old method : 0.032798051834106445 length of segment : 266 time for calcul the mask position with numpy : 0.0008063316345214844 nb_pixel_total : 37879 time to create 1 rle with old method : 0.04610705375671387 length of segment : 114 time for calcul the mask position with numpy : 0.0020842552185058594 nb_pixel_total : 88734 time to create 1 rle with old method : 0.10515332221984863 length of segment : 314 time for calcul the mask position with numpy : 0.0007481575012207031 nb_pixel_total : 29487 time to create 1 rle with old method : 0.033110857009887695 length of segment : 205 time for calcul the mask position with numpy : 0.006590366363525391 nb_pixel_total : 236899 time to create 1 rle with new method : 0.014578819274902344 length of segment : 603 time for calcul the mask position with numpy : 0.2927424907684326 nb_pixel_total : 432450 time to create 1 rle with new method : 0.02463698387145996 length of segment : 592 time for calcul the mask position with numpy : 0.0012345314025878906 nb_pixel_total : 30382 time to create 1 rle with old method : 0.0342860221862793 length of segment : 341 time for calcul the mask position with numpy : 0.0012531280517578125 nb_pixel_total : 50559 time to create 1 rle with old method : 0.05782914161682129 length of segment : 296 time for calcul the mask position with numpy : 0.0012328624725341797 nb_pixel_total : 48545 time to create 1 rle with old method : 0.058586835861206055 length of segment : 297 time for calcul the mask position with numpy : 0.0008847713470458984 nb_pixel_total : 28844 time to create 1 rle with old method : 0.034533023834228516 length of segment : 201 time for calcul the mask position with numpy : 0.0003840923309326172 nb_pixel_total : 7494 time to create 1 rle with old method : 0.009203433990478516 length of segment : 110 time for calcul the mask position with numpy : 0.0021026134490966797 nb_pixel_total : 91673 time to create 1 rle with old method : 0.11083745956420898 length of segment : 282 time for calcul the mask position with numpy : 0.002176523208618164 nb_pixel_total : 87155 time to create 1 rle with old method : 0.10642051696777344 length of segment : 401 time for calcul the mask position with numpy : 0.0004246234893798828 nb_pixel_total : 14182 time to create 1 rle with old method : 0.01666879653930664 length of segment : 128 time for calcul the mask position with numpy : 0.0030465126037597656 nb_pixel_total : 115741 time to create 1 rle with old method : 0.13234496116638184 length of segment : 478 time for calcul the mask position with numpy : 0.0015437602996826172 nb_pixel_total : 61343 time to create 1 rle with old method : 0.07581043243408203 length of segment : 309 time for calcul the mask position with numpy : 0.0007712841033935547 nb_pixel_total : 25687 time to create 1 rle with old method : 0.030771732330322266 length of segment : 286 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 5462 time to create 1 rle with old method : 0.006530046463012695 length of segment : 88 time spent for convertir_results : 10.206653594970703 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 95 chid ids of type : 3594 Number RLEs to save : 28231 save missing photos in datou_result : time spend for datou_step_exec : 64.11654496192932 time spend to save output : 3.117476463317871 total time spend for step 1 : 67.23402142524719 step2:crop_condition Thu Oct 9 12:41:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 95 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 55 About to insert : list_path_to_insert length 55 new photo from crops ! About to upload 55 photos upload in portfolio : 3736932 init cache_photo without model_param we have 55 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760006516_2058459 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443895_0.png', 0, 442, 242, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443899_0.png', 0, 119, 164, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443900_0.png', 0, 240, 179, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443909_0.png', 0, 212, 123, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443908_0.png', 0, 84, 113, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443904_0.png', 0, 448, 348, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443903_0.png', 0, 398, 297, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443907_0.png', 0, 190, 214, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443911_0.png', 0, 341, 398, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443910_0.png', 0, 102, 250, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443912_0.png', 0, 251, 89, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443906_0.png', 0, 173, 150, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443917_0.png', 0, 130, 142, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443915_0.png', 0, 463, 588, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443921_0.png', 0, 121, 177, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443916_0.png', 0, 325, 381, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443918_0.png', 0, 222, 207, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443920_0.png', 0, 260, 253, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443932_0.png', 0, 611, 632, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443926_0.png', 0, 457, 568, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443927_0.png', 0, 116, 177, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443930_0.png', 0, 136, 353, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443931_0.png', 0, 306, 322, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443928_0.png', 0, 220, 207, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443935_0.png', 0, 341, 453, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443934_0.png', 0, 178, 242, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443946_0.png', 0, 343, 301, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443941_0.png', 0, 134, 93, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443949_0.png', 0, 235, 260, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443954_0.png', 0, 76, 167, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443952_0.png', 0, 399, 578, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443950_0.png', 0, 165, 246, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443957_0.png', 0, 688, 542, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443955_0.png', 0, 251, 488, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443963_0.png', 0, 296, 443, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443958_0.png', 0, 180, 272, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443961_0.png', 0, 119, 132, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443962_0.png', 0, 323, 360, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443960_0.png', 0, 140, 120, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443973_0.png', 0, 453, 314, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443971_0.png', 0, 143, 266, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443968_0.png', 0, 737, 584, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443970_0.png', 0, 126, 233, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443974_0.png', 0, 172, 204, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443965_0.png', 0, 143, 375, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443966_0.png', 0, 262, 238, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443980_0.png', 0, 186, 198, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443979_0.png', 0, 242, 297, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443976_0.png', 0, 928, 583, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443975_0.png', 0, 680, 601, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443977_0.png', 0, 157, 337, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443981_0.png', 0, 126, 102, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443978_0.png', 0, 268, 281, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443988_0.png', 0, 79, 86, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006531), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443987_0.png', 0, 102, 286, 0, 1760006531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 55 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.630292177200317 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760006540_2058459 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006541), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443913_0.png', 0, 195, 269, 0, 1760006541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006541), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443923_0.png', 0, 361, 354, 0, 1760006541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006541), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443940_0.png', 0, 195, 314, 0, 1760006541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006541), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443942_0.png', 0, 135, 159, 0, 1760006541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006541), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443967_0.png', 0, 196, 216, 0, 1760006541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006541), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443984_0.png', 0, 148, 127, 0, 1760006541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3359925746917725 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760006544_2058459 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006544), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443924_0.png', 0, 174, 172, 0, 1760006544,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006544), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443951_0.png', 0, 204, 162, 0, 1760006544,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.105391025543213 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3736932 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760006554_2058459 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443897_0.png', 0, 401, 297, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443898_0.png', 0, 478, 451, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443894_0.png', 0, 341, 527, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443905_0.png', 0, 472, 366, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443919_0.png', 0, 209, 322, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443914_0.png', 0, 630, 337, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443925_0.png', 0, 323, 533, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443922_0.png', 0, 212, 125, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443929_0.png', 0, 265, 562, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443936_0.png', 0, 572, 269, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443938_0.png', 0, 292, 113, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443937_0.png', 0, 290, 284, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443939_0.png', 0, 165, 140, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443933_0.png', 0, 287, 207, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443944_0.png', 0, 408, 175, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443948_0.png', 0, 156, 83, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443947_0.png', 0, 171, 129, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443943_0.png', 0, 180, 194, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443953_0.png', 0, 322, 210, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443959_0.png', 0, 341, 231, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443972_0.png', 0, 428, 111, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443969_0.png', 0, 336, 300, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443983_0.png', 0, 335, 358, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443982_0.png', 0, 476, 279, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006568), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443986_0.png', 0, 278, 300, 0, 1760006568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 25 photos in the portfolio 3736932 time of upload the photos Elapsed time : 17.278217792510986 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760006574_2058459 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006575), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443902_0.png', 0, 210, 237, 0, 1760006575,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006575), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443901_0.png', 0, 126, 132, 0, 1760006575,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006575), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443896_0.png', 0, 97, 125, 0, 1760006575,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006575), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443945_0.png', 0, 105, 119, 0, 1760006575,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006575), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443956_0.png', 0, 202, 257, 0, 1760006575,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3312058448791504 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760006579_2058459 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006579), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443964_0.png', 0, 202, 306, 0, 1760006579,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760006579), 0.0, 0.0, 14, '', 0, 0, '1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443985_0.png', 0, 361, 450, 0, 1760006579,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9007174968719482 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1388378063, 1388378062, 1388378061, 1388378058, 1388378052, 1388378051, 1388378033, 1388378019, 1388377917, 1388377916, 1388377915] Looping around the photos to save general results len do output : 95 /1388393812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388393991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388394005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388394024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388394039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388394190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388394191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378063', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378062', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378061', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378058', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378052', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378051', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378033', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378019', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377917', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377916', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377915', None, None, None, None, None, '3903287') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 296 time used for this insertion : 0.04489731788635254 save_final save missing photos in datou_result : time spend for datou_step_exec : 81.76346588134766 time spend to save output : 0.04879164695739746 total time spend for step 2 : 81.81225752830505 step3:rle_unique_nms_with_priority Thu Oct 9 12:43:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 95 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 7.088319540023804 time for calcul the mask position with numpy : 0.08749127388000488 nb_pixel_total : 7777358 time to create 1 rle with new method : 0.40888047218322754 time for calcul the mask position with numpy : 0.027704715728759766 nb_pixel_total : 38197 time to create 1 rle with old method : 0.0446629524230957 time for calcul the mask position with numpy : 0.02753138542175293 nb_pixel_total : 14841 time to create 1 rle with old method : 0.020699739456176758 time for calcul the mask position with numpy : 0.026302099227905273 nb_pixel_total : 21928 time to create 1 rle with old method : 0.02603292465209961 time for calcul the mask position with numpy : 0.02794480323791504 nb_pixel_total : 8439 time to create 1 rle with old method : 0.012198925018310547 time for calcul the mask position with numpy : 0.02751326560974121 nb_pixel_total : 170025 time to create 1 rle with new method : 0.17234086990356445 time for calcul the mask position with numpy : 0.02972555160522461 nb_pixel_total : 81029 time to create 1 rle with old method : 0.09624910354614258 time for calcul the mask position with numpy : 0.02741241455078125 nb_pixel_total : 10111 time to create 1 rle with old method : 0.01167607307434082 time for calcul the mask position with numpy : 0.02545309066772461 nb_pixel_total : 61208 time to create 1 rle with old method : 0.0699622631072998 time for calcul the mask position with numpy : 0.02411675453186035 nb_pixel_total : 111264 time to create 1 rle with old method : 0.12722110748291016 create new chi : 1.3618364334106445 time to delete rle : 0.06934952735900879 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 7083 TO DO : save crop sub photo not yet done ! save time : 0.9152016639709473 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 6.417673110961914 time for calcul the mask position with numpy : 1.610044002532959 nb_pixel_total : 7769926 time to create 1 rle with new method : 1.3656911849975586 time for calcul the mask position with numpy : 0.023609638214111328 nb_pixel_total : 33786 time to create 1 rle with old method : 0.038400888442993164 time for calcul the mask position with numpy : 0.023340225219726562 nb_pixel_total : 17088 time to create 1 rle with old method : 0.01910257339477539 time for calcul the mask position with numpy : 0.024481534957885742 nb_pixel_total : 80613 time to create 1 rle with old method : 0.08849668502807617 time for calcul the mask position with numpy : 0.02426934242248535 nb_pixel_total : 17465 time to create 1 rle with old method : 0.019989490509033203 time for calcul the mask position with numpy : 0.024849414825439453 nb_pixel_total : 21998 time to create 1 rle with old method : 0.026875734329223633 time for calcul the mask position with numpy : 0.02505660057067871 nb_pixel_total : 7611 time to create 1 rle with old method : 0.008713960647583008 time for calcul the mask position with numpy : 0.02466726303100586 nb_pixel_total : 31689 time to create 1 rle with old method : 0.03535938262939453 time for calcul the mask position with numpy : 0.02548670768737793 nb_pixel_total : 13371 time to create 1 rle with old method : 0.015537261962890625 time for calcul the mask position with numpy : 0.026226520538330078 nb_pixel_total : 133129 time to create 1 rle with old method : 0.15177202224731445 time for calcul the mask position with numpy : 0.024895429611206055 nb_pixel_total : 98950 time to create 1 rle with old method : 0.11087608337402344 time for calcul the mask position with numpy : 0.027323484420776367 nb_pixel_total : 68774 time to create 1 rle with old method : 0.07952141761779785 create new chi : 3.8825595378875732 time to delete rle : 0.0011112689971923828 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7758 TO DO : save crop sub photo not yet done ! save time : 0.9493718147277832 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 7.182288885116577 time for calcul the mask position with numpy : 0.5584356784820557 nb_pixel_total : 7515726 time to create 1 rle with new method : 1.156813144683838 time for calcul the mask position with numpy : 0.024318933486938477 nb_pixel_total : 137299 time to create 1 rle with old method : 0.15455222129821777 time for calcul the mask position with numpy : 0.024109601974487305 nb_pixel_total : 22058 time to create 1 rle with old method : 0.02514338493347168 time for calcul the mask position with numpy : 0.024943113327026367 nb_pixel_total : 65997 time to create 1 rle with old method : 0.0801994800567627 time for calcul the mask position with numpy : 0.02478623390197754 nb_pixel_total : 22201 time to create 1 rle with old method : 0.025090694427490234 time for calcul the mask position with numpy : 0.024245500564575195 nb_pixel_total : 13474 time to create 1 rle with old method : 0.015398263931274414 time for calcul the mask position with numpy : 0.024379968643188477 nb_pixel_total : 42415 time to create 1 rle with old method : 0.04765796661376953 time for calcul the mask position with numpy : 0.02543044090270996 nb_pixel_total : 49633 time to create 1 rle with old method : 0.05708503723144531 time for calcul the mask position with numpy : 0.024690866470336914 nb_pixel_total : 27784 time to create 1 rle with old method : 0.03133749961853027 time for calcul the mask position with numpy : 0.023950815200805664 nb_pixel_total : 10755 time to create 1 rle with old method : 0.012151002883911133 time for calcul the mask position with numpy : 0.023523807525634766 nb_pixel_total : 68113 time to create 1 rle with old method : 0.07499980926513672 time for calcul the mask position with numpy : 0.024808883666992188 nb_pixel_total : 183540 time to create 1 rle with new method : 1.4670472145080566 time for calcul the mask position with numpy : 0.026631593704223633 nb_pixel_total : 135405 time to create 1 rle with old method : 0.1541883945465088 create new chi : 4.228280067443848 time to delete rle : 0.001367330551147461 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 10030 TO DO : save crop sub photo not yet done ! save time : 1.1867220401763916 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.5574352741241455 time for calcul the mask position with numpy : 1.670546293258667 nb_pixel_total : 7658889 time to create 1 rle with new method : 1.1948697566986084 time for calcul the mask position with numpy : 0.02481245994567871 nb_pixel_total : 250609 time to create 1 rle with new method : 0.9121217727661133 time for calcul the mask position with numpy : 0.022988080978393555 nb_pixel_total : 50532 time to create 1 rle with old method : 0.055535316467285156 time for calcul the mask position with numpy : 0.02303910255432129 nb_pixel_total : 31839 time to create 1 rle with old method : 0.034703969955444336 time for calcul the mask position with numpy : 0.023155689239501953 nb_pixel_total : 89582 time to create 1 rle with old method : 0.0999903678894043 time for calcul the mask position with numpy : 0.02543926239013672 nb_pixel_total : 26752 time to create 1 rle with old method : 0.030263662338256836 time for calcul the mask position with numpy : 0.02397298812866211 nb_pixel_total : 12368 time to create 1 rle with old method : 0.013785839080810547 time for calcul the mask position with numpy : 0.024649620056152344 nb_pixel_total : 173829 time to create 1 rle with new method : 1.4012229442596436 create new chi : 5.6753318309783936 time to delete rle : 0.0012068748474121094 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 8198 TO DO : save crop sub photo not yet done ! save time : 1.0412230491638184 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 5.756880044937134 time for calcul the mask position with numpy : 2.635925054550171 nb_pixel_total : 7896774 time to create 1 rle with new method : 1.1683661937713623 time for calcul the mask position with numpy : 0.022670745849609375 nb_pixel_total : 26122 time to create 1 rle with old method : 0.028953075408935547 time for calcul the mask position with numpy : 0.023067712783813477 nb_pixel_total : 19660 time to create 1 rle with old method : 0.021592140197753906 time for calcul the mask position with numpy : 0.0388946533203125 nb_pixel_total : 26179 time to create 1 rle with old method : 0.02848076820373535 time for calcul the mask position with numpy : 0.030611753463745117 nb_pixel_total : 61791 time to create 1 rle with old method : 0.0683739185333252 time for calcul the mask position with numpy : 0.024959564208984375 nb_pixel_total : 141732 time to create 1 rle with old method : 0.15604233741760254 time for calcul the mask position with numpy : 0.024727344512939453 nb_pixel_total : 41469 time to create 1 rle with old method : 0.04557228088378906 time for calcul the mask position with numpy : 0.02397465705871582 nb_pixel_total : 31110 time to create 1 rle with old method : 0.03409576416015625 time for calcul the mask position with numpy : 0.02326679229736328 nb_pixel_total : 49563 time to create 1 rle with old method : 0.0540614128112793 create new chi : 4.495229244232178 time to delete rle : 0.0008301734924316406 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6234 TO DO : save crop sub photo not yet done ! save time : 0.7985992431640625 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.695092678070068 time for calcul the mask position with numpy : 1.3048014640808105 nb_pixel_total : 8095631 time to create 1 rle with new method : 0.922081470489502 time for calcul the mask position with numpy : 0.024480342864990234 nb_pixel_total : 10599 time to create 1 rle with old method : 0.01575756072998047 time for calcul the mask position with numpy : 0.025760650634765625 nb_pixel_total : 17630 time to create 1 rle with old method : 0.029787302017211914 time for calcul the mask position with numpy : 0.02745199203491211 nb_pixel_total : 64634 time to create 1 rle with old method : 0.07309389114379883 time for calcul the mask position with numpy : 0.023493528366088867 nb_pixel_total : 9487 time to create 1 rle with old method : 0.010434150695800781 time for calcul the mask position with numpy : 0.023972511291503906 nb_pixel_total : 45574 time to create 1 rle with old method : 0.050566911697387695 time for calcul the mask position with numpy : 0.023294448852539062 nb_pixel_total : 26571 time to create 1 rle with old method : 0.028713703155517578 time for calcul the mask position with numpy : 0.0232694149017334 nb_pixel_total : 14837 time to create 1 rle with old method : 0.01606297492980957 time for calcul the mask position with numpy : 0.024263620376586914 nb_pixel_total : 9437 time to create 1 rle with old method : 0.010854959487915039 create new chi : 2.701512575149536 time to delete rle : 0.0007338523864746094 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 4740 TO DO : save crop sub photo not yet done ! save time : 0.6630866527557373 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 5.02548623085022 time for calcul the mask position with numpy : 1.2352023124694824 nb_pixel_total : 7747366 time to create 1 rle with new method : 0.9283332824707031 time for calcul the mask position with numpy : 0.025763750076293945 nb_pixel_total : 167427 time to create 1 rle with new method : 1.1976606845855713 time for calcul the mask position with numpy : 0.02382802963256836 nb_pixel_total : 43702 time to create 1 rle with old method : 0.05028843879699707 time for calcul the mask position with numpy : 0.02737903594970703 nb_pixel_total : 81589 time to create 1 rle with old method : 0.09049320220947266 time for calcul the mask position with numpy : 0.022977828979492188 nb_pixel_total : 7317 time to create 1 rle with old method : 0.008061408996582031 time for calcul the mask position with numpy : 0.03299760818481445 nb_pixel_total : 46363 time to create 1 rle with old method : 0.05177116394042969 time for calcul the mask position with numpy : 0.04040265083312988 nb_pixel_total : 116548 time to create 1 rle with old method : 0.13242292404174805 time for calcul the mask position with numpy : 0.041117191314697266 nb_pixel_total : 25050 time to create 1 rle with old method : 0.028175830841064453 time for calcul the mask position with numpy : 0.0354466438293457 nb_pixel_total : 21703 time to create 1 rle with old method : 0.024242401123046875 time for calcul the mask position with numpy : 0.03604269027709961 nb_pixel_total : 37335 time to create 1 rle with old method : 0.045551300048828125 create new chi : 4.149315357208252 time to delete rle : 0.0012633800506591797 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7965 TO DO : save crop sub photo not yet done ! save time : 0.9505302906036377 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.406879425048828 time for calcul the mask position with numpy : 1.129373550415039 nb_pixel_total : 7996388 time to create 1 rle with new method : 1.4936254024505615 time for calcul the mask position with numpy : 0.02359747886657715 nb_pixel_total : 38134 time to create 1 rle with old method : 0.0422210693359375 time for calcul the mask position with numpy : 0.023450374603271484 nb_pixel_total : 73481 time to create 1 rle with old method : 0.08151841163635254 time for calcul the mask position with numpy : 0.02402353286743164 nb_pixel_total : 92463 time to create 1 rle with old method : 0.10430693626403809 time for calcul the mask position with numpy : 0.025424718856811523 nb_pixel_total : 12652 time to create 1 rle with old method : 0.014427661895751953 time for calcul the mask position with numpy : 0.024532556533813477 nb_pixel_total : 12618 time to create 1 rle with old method : 0.014359474182128906 time for calcul the mask position with numpy : 0.03181123733520508 nb_pixel_total : 44024 time to create 1 rle with old method : 0.06616711616516113 time for calcul the mask position with numpy : 0.044397592544555664 nb_pixel_total : 24640 time to create 1 rle with old method : 0.027417898178100586 create new chi : 3.2133424282073975 time to delete rle : 0.0009706020355224609 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++Number RLEs to save : 6358 TO DO : save crop sub photo not yet done ! save time : 0.8003876209259033 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.582229137420654 time for calcul the mask position with numpy : 1.7191736698150635 nb_pixel_total : 7663677 time to create 1 rle with new method : 0.7640032768249512 time for calcul the mask position with numpy : 0.029530048370361328 nb_pixel_total : 29487 time to create 1 rle with old method : 0.04756331443786621 time for calcul the mask position with numpy : 0.02653646469116211 nb_pixel_total : 88734 time to create 1 rle with old method : 0.10008740425109863 time for calcul the mask position with numpy : 0.023261547088623047 nb_pixel_total : 37879 time to create 1 rle with old method : 0.0435943603515625 time for calcul the mask position with numpy : 0.0249178409576416 nb_pixel_total : 27635 time to create 1 rle with old method : 0.03266024589538574 time for calcul the mask position with numpy : 0.03124690055847168 nb_pixel_total : 20202 time to create 1 rle with old method : 0.025971651077270508 time for calcul the mask position with numpy : 0.030083417892456055 nb_pixel_total : 59899 time to create 1 rle with old method : 0.06820225715637207 time for calcul the mask position with numpy : 0.025753259658813477 nb_pixel_total : 258947 time to create 1 rle with new method : 0.8404586315155029 time for calcul the mask position with numpy : 0.029166221618652344 nb_pixel_total : 27527 time to create 1 rle with old method : 0.03226423263549805 time for calcul the mask position with numpy : 0.030319690704345703 nb_pixel_total : 38321 time to create 1 rle with old method : 0.04465079307556152 time for calcul the mask position with numpy : 0.0404052734375 nb_pixel_total : 42092 time to create 1 rle with old method : 0.04850602149963379 create new chi : 4.136792421340942 time to delete rle : 0.001402139663696289 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8186 TO DO : save crop sub photo not yet done ! save time : 1.0021562576293945 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 3.451889753341675 time for calcul the mask position with numpy : 1.026435136795044 nb_pixel_total : 7280399 time to create 1 rle with new method : 1.3185687065124512 time for calcul the mask position with numpy : 0.023234128952026367 nb_pixel_total : 87155 time to create 1 rle with old method : 0.09309864044189453 time for calcul the mask position with numpy : 0.02329564094543457 nb_pixel_total : 91673 time to create 1 rle with old method : 0.10177922248840332 time for calcul the mask position with numpy : 0.023360252380371094 nb_pixel_total : 7494 time to create 1 rle with old method : 0.008620738983154297 time for calcul the mask position with numpy : 0.03949379920959473 nb_pixel_total : 28844 time to create 1 rle with old method : 0.032828569412231445 time for calcul the mask position with numpy : 0.03464913368225098 nb_pixel_total : 48545 time to create 1 rle with old method : 0.05239701271057129 time for calcul the mask position with numpy : 0.03700757026672363 nb_pixel_total : 50559 time to create 1 rle with old method : 0.05423760414123535 time for calcul the mask position with numpy : 0.022825956344604492 nb_pixel_total : 30382 time to create 1 rle with old method : 0.03403878211975098 time for calcul the mask position with numpy : 0.02539992332458496 nb_pixel_total : 432450 time to create 1 rle with new method : 1.5903749465942383 time for calcul the mask position with numpy : 0.024739503860473633 nb_pixel_total : 236899 time to create 1 rle with new method : 1.0157132148742676 create new chi : 5.675304174423218 time to delete rle : 0.0012328624725341797 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 8406 TO DO : save crop sub photo not yet done ! save time : 1.0191025733947754 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 2.0052616596221924 time for calcul the mask position with numpy : 1.044471025466919 nb_pixel_total : 8071985 time to create 1 rle with new method : 0.9800164699554443 time for calcul the mask position with numpy : 0.0236358642578125 nb_pixel_total : 5462 time to create 1 rle with old method : 0.0062482357025146484 time for calcul the mask position with numpy : 0.023015737533569336 nb_pixel_total : 25687 time to create 1 rle with old method : 0.028062820434570312 time for calcul the mask position with numpy : 0.024357318878173828 nb_pixel_total : 61343 time to create 1 rle with old method : 0.07014083862304688 time for calcul the mask position with numpy : 0.024145126342773438 nb_pixel_total : 115741 time to create 1 rle with old method : 0.1306474208831787 time for calcul the mask position with numpy : 0.023354053497314453 nb_pixel_total : 14182 time to create 1 rle with old method : 0.015584707260131836 create new chi : 2.438828945159912 time to delete rle : 0.0007226467132568359 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4738 TO DO : save crop sub photo not yet done ! save time : 0.647066593170166 map_output_result : {1388378063: (0.0, 'Should be the crop_list due to order', 0), 1388378062: (0.0, 'Should be the crop_list due to order', 0), 1388378061: (0.0, 'Should be the crop_list due to order', 0), 1388378058: (0.0, 'Should be the crop_list due to order', 0), 1388378052: (0.0, 'Should be the crop_list due to order', 0), 1388378051: (0.0, 'Should be the crop_list due to order', 0), 1388378033: (0.0, 'Should be the crop_list due to order', 0), 1388378019: (0.0, 'Should be the crop_list due to order', 0), 1388377917: (0.0, 'Should be the crop_list due to order', 0), 1388377916: (0.0, 'Should be the crop_list due to order', 0), 1388377915: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1388378063, 1388378062, 1388378061, 1388378058, 1388378052, 1388378051, 1388378033, 1388378019, 1388377917, 1388377916, 1388377915] Looping around the photos to save general results len do output : 11 /1388378063.Didn't retrieve data . /1388378062.Didn't retrieve data . /1388378061.Didn't retrieve data . /1388378058.Didn't retrieve data . /1388378052.Didn't retrieve data . /1388378051.Didn't retrieve data . /1388378033.Didn't retrieve data . /1388378019.Didn't retrieve data . /1388377917.Didn't retrieve data . /1388377916.Didn't retrieve data . /1388377915.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378063', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378062', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378061', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378058', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378052', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378051', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378033', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378019', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377917', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377916', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377915', None, None, None, None, None, '3903287') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.03682136535644531 save_final save missing photos in datou_result : time spend for datou_step_exec : 107.5042781829834 time spend to save output : 0.037332773208618164 total time spend for step 3 : 107.54161095619202 step4:ventilate_hashtags_in_portfolio Thu Oct 9 12:44:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27642741 get user id for portfolio 27642741 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27642741 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','pet_clair','pehd','pet_fonce','background','flou','mal_croppe','carton','autre','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27642741 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','pet_clair','pehd','pet_fonce','background','flou','mal_croppe','carton','autre','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27642741 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','pet_clair','pehd','pet_fonce','background','flou','mal_croppe','carton','autre','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27643051,27643052,27643053,27643054,27643055,27643056,27643057,27643058,27643059,27643060,27643061?tags=metal,environnement,pet_clair,pehd,pet_fonce,background,flou,mal_croppe,carton,autre,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1388378063, 1388378062, 1388378061, 1388378058, 1388378052, 1388378051, 1388378033, 1388378019, 1388377917, 1388377916, 1388377915] Looping around the photos to save general results len do output : 1 /27642741. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378063', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378062', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378061', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378058', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378052', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378051', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378033', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378019', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377917', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377916', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377915', None, None, None, None, None, '3903287') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.03833436965942383 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.669275760650635 time spend to save output : 0.03904151916503906 total time spend for step 4 : 5.708317279815674 step5:final Thu Oct 9 12:44:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1388378063: ('0.06317823416456231',), 1388378062: ('0.06317823416456231',), 1388378061: ('0.06317823416456231',), 1388378058: ('0.06317823416456231',), 1388378052: ('0.06317823416456231',), 1388378051: ('0.06317823416456231',), 1388378033: ('0.06317823416456231',), 1388378019: ('0.06317823416456231',), 1388377917: ('0.06317823416456231',), 1388377916: ('0.06317823416456231',), 1388377915: ('0.06317823416456231',)} new output for save of step final : {1388378063: ('0.06317823416456231',), 1388378062: ('0.06317823416456231',), 1388378061: ('0.06317823416456231',), 1388378058: ('0.06317823416456231',), 1388378052: ('0.06317823416456231',), 1388378051: ('0.06317823416456231',), 1388378033: ('0.06317823416456231',), 1388378019: ('0.06317823416456231',), 1388377917: ('0.06317823416456231',), 1388377916: ('0.06317823416456231',), 1388377915: ('0.06317823416456231',)} [1388378063, 1388378062, 1388378061, 1388378058, 1388378052, 1388378051, 1388378033, 1388378019, 1388377917, 1388377916, 1388377915] Looping around the photos to save general results len do output : 11 /1388378063.Didn't retrieve data . /1388378062.Didn't retrieve data . /1388378061.Didn't retrieve data . /1388378058.Didn't retrieve data . /1388378052.Didn't retrieve data . /1388378051.Didn't retrieve data . /1388378033.Didn't retrieve data . /1388378019.Didn't retrieve data . /1388377917.Didn't retrieve data . /1388377916.Didn't retrieve data . /1388377915.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378063', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378062', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378061', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378058', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378052', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378051', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378033', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378019', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377917', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377916', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377915', None, None, None, None, None, '3903287') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.037332773208618164 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3767967224121094 time spend to save output : 0.03785395622253418 total time spend for step 5 : 0.41465067863464355 step6:blur_detection Thu Oct 9 12:44:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499.jpg resize: (2160, 3840) 1388378063 -6.998197509821271 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31.jpg resize: (2160, 3840) 1388378062 -7.1319648065017205 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c.jpg resize: (2160, 3840) 1388378061 -7.20287320996808 treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f.jpg resize: (2160, 3840) 1388378058 -7.088635969981774 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c.jpg resize: (2160, 3840) 1388378052 -7.082027108936595 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14.jpg resize: (2160, 3840) 1388378051 -7.03932471508702 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530.jpg resize: (2160, 3840) 1388378033 -6.972961052179142 treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb.jpg resize: (2160, 3840) 1388378019 -7.005484887076556 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c.jpg resize: (2160, 3840) 1388377917 -6.995875445027779 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142.jpg resize: (2160, 3840) 1388377916 -7.052062253023699 treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd.jpg resize: (2160, 3840) 1388377915 -7.138240944084488 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443895_0.png resize: (242, 442) 1388393812 -4.085980552106057 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443899_0.png resize: (164, 119) 1388393813 -3.2316387420940944 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443900_0.png resize: (179, 240) 1388393814 -3.743858837638221 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443909_0.png resize: (123, 212) 1388393815 -3.9510404633021072 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443908_0.png resize: (113, 84) 1388393816 -4.161052824500123 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443904_0.png resize: (348, 448) 1388393817 -3.656859809510307 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443903_0.png resize: (297, 398) 1388393818 -4.408248507454258 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443907_0.png resize: (214, 190) 1388393819 -3.0703255967930327 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443911_0.png resize: (398, 341) 1388393820 -5.372563109744254 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443910_0.png resize: (250, 102) 1388393821 -3.6586694606132157 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443912_0.png resize: (89, 251) 1388393822 -3.795607601380349 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443906_0.png resize: (150, 173) 1388393823 -4.253363834459662 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443917_0.png resize: (142, 130) 1388393824 -4.117051838225498 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443915_0.png resize: (588, 463) 1388393825 -2.9042243771788607 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443921_0.png resize: (177, 121) 1388393826 -3.0270993635368835 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443916_0.png resize: (381, 325) 1388393827 -3.9848508490121093 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443918_0.png resize: (207, 222) 1388393828 -2.741040872170454 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443920_0.png resize: (253, 260) 1388393829 -2.306795166628982 treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443932_0.png resize: (632, 611) 1388393830 -4.154938068126961 treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443926_0.png resize: (568, 457) 1388393831 -3.251685950114049 treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443927_0.png resize: (177, 116) 1388393832 -2.3623208112854983 treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443930_0.png resize: (353, 136) 1388393833 -3.8094699782842274 treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443931_0.png resize: (322, 306) 1388393834 -3.874946945301009 treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443928_0.png resize: (207, 220) 1388393835 -2.826157338857158 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443935_0.png resize: (453, 341) 1388393836 -1.4127474836973923 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443934_0.png resize: (242, 178) 1388393837 -3.7974625594386526 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443946_0.png resize: (301, 343) 1388393838 -5.193473384749792 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443941_0.png resize: (93, 134) 1388393839 -4.5113077129854515 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443949_0.png resize: (260, 235) 1388393840 -4.862800709027437 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443954_0.png resize: (167, 76) 1388393841 -4.116651814557363 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443952_0.png resize: (578, 399) 1388393842 -4.845682642317869 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443950_0.png resize: (246, 165) 1388393843 -3.7646892608195173 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443957_0.png resize: (542, 688) 1388393844 -4.161289567708581 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443955_0.png resize: (488, 251) 1388393845 -4.484761964752081 treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443963_0.png resize: (443, 296) 1388393846 -3.6378962595059665 treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443958_0.png resize: (272, 180) 1388393847 -4.081178955460064 treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443961_0.png resize: (132, 119) 1388393848 -2.1866417378704552 treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443962_0.png resize: (360, 323) 1388393849 -5.529003780975564 treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443960_0.png resize: (120, 140) 1388393850 -3.135590986641169 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443973_0.png resize: (314, 453) 1388393851 -5.075173870002422 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443971_0.png resize: (266, 143) 1388393852 -4.1730096478948635 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443968_0.png resize: (584, 737) 1388393853 -5.451166595126356 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443970_0.png resize: (233, 126) 1388393854 -4.829734834131472 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443974_0.png resize: (204, 172) 1388393855 -3.3283249484297333 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443965_0.png resize: (375, 143) 1388393856 -4.098806694760958 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443966_0.png resize: (238, 262) 1388393857 -3.984375491188881 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443980_0.png resize: (198, 186) 1388393858 -4.084688728587681 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443979_0.png resize: (297, 242) 1388393859 -4.5538812970640885 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443976_0.png resize: (583, 928) 1388393860 -2.7240891124375692 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443975_0.png resize: (601, 680) 1388393861 -2.565701760406771 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443977_0.png resize: (337, 157) 1388393862 -4.456018841268529 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443981_0.png resize: (102, 126) 1388393863 -2.8174963697729085 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443978_0.png resize: (281, 268) 1388393864 -3.301885637742044 treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443988_0.png resize: (86, 79) 1388393865 -4.531547550257933 treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443987_0.png resize: (286, 102) 1388393866 -3.6900154416330806 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443913_0.png resize: (269, 195) 1388393868 -3.7866052187295804 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443923_0.png resize: (354, 361) 1388393869 -5.163897702319728 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443940_0.png resize: (314, 195) 1388393870 -3.551206418336951 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443942_0.png resize: (159, 135) 1388393871 -2.8134779537373222 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443967_0.png resize: (216, 196) 1388393872 -3.6285916200895167 treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443984_0.png resize: (127, 148) 1388393873 -1.590860826081974 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443924_0.png resize: (172, 174) 1388393876 -4.960810734643311 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443951_0.png resize: (162, 204) 1388393878 -4.60372427566245 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443897_0.png resize: (297, 401) 1388393906 -3.0267458323189147 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443898_0.png resize: (451, 478) 1388393907 -5.657208647215206 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443894_0.png resize: (527, 341) 1388393908 -5.172331350945453 treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443905_0.png resize: (366, 472) 1388393909 -5.459712399692291 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443919_0.png resize: (322, 209) 1388393910 -3.8930626601852825 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443914_0.png resize: (337, 630) 1388393911 -5.59125817272211 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443925_0.png resize: (533, 323) 1388393912 -4.781157702531698 treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443922_0.png resize: (125, 212) 1388393913 -4.065817330480338 treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443929_0.png resize: (562, 265) 1388393914 -4.36551962367474 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443936_0.png resize: (269, 572) 1388393915 -2.892529832384888 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443938_0.png resize: (113, 292) 1388393917 -5.221319517513361 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443937_0.png resize: (284, 290) 1388393918 -4.950232382873267 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443939_0.png resize: (140, 165) 1388393919 -4.377843655251084 treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443933_0.png resize: (207, 287) 1388393920 -4.947572403470233 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443944_0.png resize: (175, 408) 1388393921 -2.5900985956180533 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443948_0.png resize: (83, 156) 1388393922 -3.3718862305467185 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443947_0.png resize: (129, 171) 1388393923 -4.302127985715698 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443943_0.png resize: (194, 180) 1388393924 -4.921949493876753 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443953_0.png resize: (210, 322) 1388393925 -4.742529501340239 treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443959_0.png resize: (231, 341) 1388393926 -3.4025550653438343 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443972_0.png resize: (111, 428) 1388393927 -5.538318870544185 treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443969_0.png resize: (300, 336) 1388393928 -3.3571664680539937 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443983_0.png resize: (358, 335) 1388393929 -4.392600601721415 treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443982_0.png resize: (279, 476) 1388393930 -5.229040806624097 treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443986_0.png resize: (300, 278) 1388393931 -5.715534325712288 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443902_0.png resize: (237, 210) 1388393977 -2.911704491122514 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443901_0.png resize: (132, 126) 1388393991 -3.038369309736728 treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443896_0.png resize: (125, 97) 1388394005 -3.821816744584335 treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443945_0.png resize: (119, 105) 1388394024 -4.562191442038299 treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443956_0.png resize: (257, 202) 1388394039 -4.804442680376687 treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443964_0.png resize: (306, 202) 1388394190 -4.190321981886831 treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443985_0.png resize: (450, 361) 1388394191 -5.952585471915345 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 106 time used for this insertion : 0.03979039192199707 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 106 time used for this insertion : 0.0775296688079834 save missing photos in datou_result : time spend for datou_step_exec : 37.64926600456238 time spend to save output : 0.13544797897338867 total time spend for step 6 : 37.78471398353577 step7:brightness Thu Oct 9 12:45:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499.jpg treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31.jpg treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c.jpg treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f.jpg treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c.jpg treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14.jpg treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530.jpg treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb.jpg treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c.jpg treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142.jpg treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd.jpg treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443895_0.png treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443899_0.png treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443900_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443909_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443908_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443904_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443903_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443907_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443911_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443910_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443912_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443906_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443917_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443915_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443921_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443916_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443918_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443920_0.png treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443932_0.png treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443926_0.png treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443927_0.png treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443930_0.png treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443931_0.png treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443928_0.png treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443935_0.png treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443934_0.png treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443946_0.png treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443941_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443949_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443954_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443952_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443950_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443957_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443955_0.png treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443963_0.png treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443958_0.png treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443961_0.png treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443962_0.png treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443960_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443973_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443971_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443968_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443970_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443974_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443965_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443966_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443980_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443979_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443976_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443975_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443977_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443981_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443978_0.png treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443988_0.png treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443987_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443913_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443923_0.png treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443940_0.png treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443942_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443967_0.png treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443984_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443924_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443951_0.png treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443897_0.png treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443898_0.png treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443894_0.png treat image : temp/1760006428_2058459_1388378062_e6f32a461907dabd1b84a0abd56f9f31_rle_crop_3990443905_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443919_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443914_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443925_0.png treat image : temp/1760006428_2058459_1388378061_ef91f7b86891af224fc2a2d4b020db9c_rle_crop_3990443922_0.png treat image : temp/1760006428_2058459_1388378058_810102c26e44c9748b7c17991d37107f_rle_crop_3990443929_0.png treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443936_0.png treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443938_0.png treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443937_0.png treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443939_0.png treat image : temp/1760006428_2058459_1388378052_73fd5910d2e429d68afcab132abe094c_rle_crop_3990443933_0.png treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443944_0.png treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443948_0.png treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443947_0.png treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443943_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443953_0.png treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443959_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443972_0.png treat image : temp/1760006428_2058459_1388377917_bbe8e70349027fe4d07babd70a00499c_rle_crop_3990443969_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443983_0.png treat image : temp/1760006428_2058459_1388377916_9a0fc1786990b7ac6c9fd355de4de142_rle_crop_3990443982_0.png treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443986_0.png treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443902_0.png treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443901_0.png treat image : temp/1760006428_2058459_1388378063_f644bfa0c7076f35b51ee681ef00d499_rle_crop_3990443896_0.png treat image : temp/1760006428_2058459_1388378051_21640cadc0771cd51dfdd152e17f1a14_rle_crop_3990443945_0.png treat image : temp/1760006428_2058459_1388378033_4ded8a4382573cb6ea784d0b233c7530_rle_crop_3990443956_0.png treat image : temp/1760006428_2058459_1388378019_40009ba5316230b7591a163dae0604bb_rle_crop_3990443964_0.png treat image : temp/1760006428_2058459_1388377915_690a712221cb31db69a9c584dbc92cbd_rle_crop_3990443985_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 106 time used for this insertion : 0.04794788360595703 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 106 time used for this insertion : 0.07867693901062012 save missing photos in datou_result : time spend for datou_step_exec : 10.512351036071777 time spend to save output : 0.14447379112243652 total time spend for step 7 : 10.656824827194214 step8:velours_tree Thu Oct 9 12:45:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1428213119506836 time spend to save output : 4.9591064453125e-05 total time spend for step 8 : 0.14287090301513672 step9:send_mail_cod Thu Oct 9 12:45:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27642741_09-10-2025_12_45_42.pdf 27643051 change filename to text .change filename to text .imagette276430511760006742 27643053 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette276430531760006742 27643054 imagette276430541760006744 27643055 change filename to text .change filename to text .imagette276430551760006744 27643056 imagette276430561760006744 27643057 imagette276430571760006744 27643058 imagette276430581760006744 27643059 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette276430591760006744 27643060 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette276430601760006745 27643061 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette276430611760006745 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27642741 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27643051,27643052,27643053,27643054,27643055,27643056,27643057,27643058,27643059,27643060,27643061?tags=metal,environnement,pet_clair,pehd,pet_fonce,background,flou,mal_croppe,carton,autre,papier args[1388378063] : ((1388378063, -6.998197509821271, 492609224), (1388378063, 0.38945580831546445, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388378062] : ((1388378062, -7.1319648065017205, 492609224), (1388378062, 0.26570543742350805, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388378061] : ((1388378061, -7.20287320996808, 492609224), (1388378061, 0.22329785216649997, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388378058] : ((1388378058, -7.088635969981774, 492609224), (1388378058, 0.22992463821747386, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388378052] : ((1388378052, -7.082027108936595, 492609224), (1388378052, 0.30216965927446543, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388378051] : ((1388378051, -7.03932471508702, 492609224), (1388378051, 0.2331157972937751, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388378033] : ((1388378033, -6.972961052179142, 492609224), (1388378033, 0.16119133615113798, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388378019] : ((1388378019, -7.005484887076556, 492609224), (1388378019, 0.3665139193840985, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388377917] : ((1388377917, -6.995875445027779, 492609224), (1388377917, 0.3577252043049576, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388377916] : ((1388377916, -7.052062253023699, 492609224), (1388377916, 0.42731007745013017, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com args[1388377915] : ((1388377915, -7.138240944084488, 492609224), (1388377915, 0.2761008463056197, 2107752395), '0.06317823416456231') We are sending mail with results at report@fotonower.com refus_total : 0.06317823416456231 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27642741 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27642741_09-10-2025_12_45_42.pdf results_Auto_P27642741_09-10-2025_12_45_42.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27642741_09-10-2025_12_45_42.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27642741','results_Auto_P27642741_09-10-2025_12_45_42.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27642741_09-10-2025_12_45_42.pdf','pdf','','0.75','0.06317823416456231') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27642741

https://www.fotonower.com/image?json=false&list_photos_id=1388378063
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388378062
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388378061
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388378058
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388378052
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388378051
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388378033
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388378019
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388377917
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388377916
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388377915
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 6.32%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/27643051?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27643053?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27643055?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27643059?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27643060?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27643061?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27642741_09-10-2025_12_45_42.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27643051,27643052,27643053,27643054,27643055,27643056,27643057,27643058,27643059,27643060,27643061?tags=metal,environnement,pet_clair,pehd,pet_fonce,background,flou,mal_croppe,carton,autre,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 09 Oct 2025 10:45:53 GMT Content-Length: 0 Connection: close X-Message-Id: i7LsFe8dTXKvqnOABz1grg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1388378063, 1388378062, 1388378061, 1388378058, 1388378052, 1388378051, 1388378033, 1388378019, 1388377917, 1388377916, 1388377915] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378063', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378062', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378061', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378058', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378052', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378051', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378033', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378019', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377917', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377916', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377915', None, None, None, None, None, '3903287') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.03706765174865723 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.106127500534058 time spend to save output : 0.03731703758239746 total time spend for step 9 : 11.143444538116455 step10:split_time_score Thu Oct 9 12:45:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 09102025 27642741 Nombre de photos uploadées : 11 / 23040 (0%) 09102025 27642741 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 09102025 27642741 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008678436279296875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.673429012298584 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.006979999940995782 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27627388_09-10-2025_07_31_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27627388 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27627388 AND mptpi.`type`=3726 To do Qualite : 0.032817041216563786 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27627402_09-10-2025_07_23_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27627402 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27627402 AND mptpi.`type`=3594 To do Qualite : 0.03697135180695989 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27627420_09-10-2025_07_16_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27627420 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27627420 AND mptpi.`type`=3726 To do Qualite : 0.029398137638777324 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27634485_09-10-2025_09_47_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27634485 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27634485 AND mptpi.`type`=3726 To do Qualite : 0.03744780642448261 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27642712_09-10-2025_12_42_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27642712 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27642712 AND mptpi.`type`=3726 To do Qualite : 0.06317823416456231 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27642741_09-10-2025_12_45_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27642741 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27642741 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'09102025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1388378063, 1388378062, 1388378061, 1388378058, 1388378052, 1388378051, 1388378033, 1388378019, 1388377917, 1388377916, 1388377915] Looping around the photos to save general results len do output : 1 /27642741Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378063', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378062', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378061', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378058', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378052', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378051', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378033', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388378019', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377917', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377916', None, None, None, None, None, '3903287') ('3318', None, None, None, None, None, None, None, '3903287') ('3318', '27642741', '1388377915', None, None, None, None, None, '3903287') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.037395477294921875 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.547240972518921 time spend to save output : 0.03764963150024414 total time spend for step 10 : 2.584890604019165 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 127.08user 127.73system 5:31.54elapsed 76%CPU (0avgtext+0avgdata 4880620maxresident)k 1799392inputs+124672outputs (6635major+10966346minor)pagefaults 0swaps