python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2274945 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3866639'] with mtr_portfolio_ids : ['27552574'] and first list_photo_ids : [] new path : /proc/2274945/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 3.9274046421051025 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Oct 7 10:50:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 8257 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-07 10:50:38.281236: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-07 10:50:38.316612: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-10-07 10:50:38.318754: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fadc8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-07 10:50:38.318810: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-07 10:50:38.323490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-07 10:50:38.458758: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x29bc8d50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-07 10:50:38.458807: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-07 10:50:38.460819: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-07 10:50:38.461245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-07 10:50:38.471382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-07 10:50:38.490758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-07 10:50:38.491766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-07 10:50:38.523614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-07 10:50:38.529182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-07 10:50:38.586626: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-07 10:50:38.589010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-07 10:50:38.589503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-07 10:50:38.590855: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-07 10:50:38.590883: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-07 10:50:38.590899: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-07 10:50:38.593676: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9591 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-07 10:50:39.114938: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-07 10:50:39.115054: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-07 10:50:39.115070: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-07 10:50:39.115085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-07 10:50:39.115099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-07 10:50:39.115112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-07 10:50:39.115125: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-07 10:50:39.115139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-07 10:50:39.116299: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-07 10:50:39.117526: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-07 10:50:39.117560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-07 10:50:39.117574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-07 10:50:39.117587: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-07 10:50:39.117599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-07 10:50:39.117612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-07 10:50:39.117624: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-07 10:50:39.117637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-07 10:50:39.118784: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-07 10:50:39.118817: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-07 10:50:39.118825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-07 10:50:39.118832: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-07 10:50:39.120029: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9591 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-07 10:50:52.236500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-07 10:50:52.425786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-07 10:50:54.185188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 Detection mask done ! Trying to reset tf kernel 2275458 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5474 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10355 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0014083385467529297 nb_pixel_total : 63702 time to create 1 rle with old method : 0.06912636756896973 length of segment : 222 time for calcul the mask position with numpy : 0.0005602836608886719 nb_pixel_total : 40189 time to create 1 rle with old method : 0.045235395431518555 length of segment : 197 time for calcul the mask position with numpy : 0.003876924514770508 nb_pixel_total : 178582 time to create 1 rle with new method : 0.009285926818847656 length of segment : 522 time for calcul the mask position with numpy : 0.0008623600006103516 nb_pixel_total : 61074 time to create 1 rle with old method : 0.06753134727478027 length of segment : 259 time for calcul the mask position with numpy : 0.0004534721374511719 nb_pixel_total : 20999 time to create 1 rle with old method : 0.025888919830322266 length of segment : 198 time for calcul the mask position with numpy : 0.0005164146423339844 nb_pixel_total : 30406 time to create 1 rle with old method : 0.03397345542907715 length of segment : 225 time for calcul the mask position with numpy : 0.0010905265808105469 nb_pixel_total : 68549 time to create 1 rle with old method : 0.07708239555358887 length of segment : 229 time for calcul the mask position with numpy : 0.0017588138580322266 nb_pixel_total : 133276 time to create 1 rle with old method : 0.1463940143585205 length of segment : 365 time for calcul the mask position with numpy : 0.0003685951232910156 nb_pixel_total : 21551 time to create 1 rle with old method : 0.024645090103149414 length of segment : 148 time for calcul the mask position with numpy : 0.00015687942504882812 nb_pixel_total : 8209 time to create 1 rle with old method : 0.00969076156616211 length of segment : 98 time for calcul the mask position with numpy : 0.0003383159637451172 nb_pixel_total : 17870 time to create 1 rle with old method : 0.02990889549255371 length of segment : 88 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 5894 time to create 1 rle with old method : 0.009760379791259766 length of segment : 106 time for calcul the mask position with numpy : 0.0003380775451660156 nb_pixel_total : 18323 time to create 1 rle with old method : 0.020912647247314453 length of segment : 202 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 22263 time to create 1 rle with old method : 0.025127887725830078 length of segment : 182 time for calcul the mask position with numpy : 0.00038933753967285156 nb_pixel_total : 12482 time to create 1 rle with old method : 0.014635324478149414 length of segment : 286 time for calcul the mask position with numpy : 0.001619577407836914 nb_pixel_total : 123750 time to create 1 rle with old method : 0.13466286659240723 length of segment : 399 time for calcul the mask position with numpy : 0.0011887550354003906 nb_pixel_total : 89201 time to create 1 rle with old method : 0.09841775894165039 length of segment : 385 time for calcul the mask position with numpy : 0.0004489421844482422 nb_pixel_total : 24702 time to create 1 rle with old method : 0.02740788459777832 length of segment : 232 time for calcul the mask position with numpy : 0.0016815662384033203 nb_pixel_total : 134827 time to create 1 rle with old method : 0.17435622215270996 length of segment : 564 time for calcul the mask position with numpy : 0.0014965534210205078 nb_pixel_total : 98010 time to create 1 rle with old method : 0.10888481140136719 length of segment : 336 time for calcul the mask position with numpy : 0.000453948974609375 nb_pixel_total : 29192 time to create 1 rle with old method : 0.033072710037231445 length of segment : 173 time for calcul the mask position with numpy : 0.0005645751953125 nb_pixel_total : 28649 time to create 1 rle with old method : 0.03190040588378906 length of segment : 285 time for calcul the mask position with numpy : 0.00023818016052246094 nb_pixel_total : 14600 time to create 1 rle with old method : 0.01657724380493164 length of segment : 138 time for calcul the mask position with numpy : 0.0003139972686767578 nb_pixel_total : 19276 time to create 1 rle with old method : 0.022465944290161133 length of segment : 125 time for calcul the mask position with numpy : 0.0005726814270019531 nb_pixel_total : 34590 time to create 1 rle with old method : 0.039414405822753906 length of segment : 174 time for calcul the mask position with numpy : 0.0006237030029296875 nb_pixel_total : 55053 time to create 1 rle with old method : 0.06075239181518555 length of segment : 175 time for calcul the mask position with numpy : 0.0011904239654541016 nb_pixel_total : 78457 time to create 1 rle with old method : 0.08437871932983398 length of segment : 353 time for calcul the mask position with numpy : 0.00011897087097167969 nb_pixel_total : 6531 time to create 1 rle with old method : 0.007353782653808594 length of segment : 87 time for calcul the mask position with numpy : 0.00014352798461914062 nb_pixel_total : 8617 time to create 1 rle with old method : 0.009985923767089844 length of segment : 65 time for calcul the mask position with numpy : 0.0005795955657958984 nb_pixel_total : 39839 time to create 1 rle with old method : 0.04396533966064453 length of segment : 201 time for calcul the mask position with numpy : 0.0003082752227783203 nb_pixel_total : 17053 time to create 1 rle with old method : 0.018926382064819336 length of segment : 158 time for calcul the mask position with numpy : 0.0009138584136962891 nb_pixel_total : 53863 time to create 1 rle with old method : 0.0576777458190918 length of segment : 401 time for calcul the mask position with numpy : 0.008242368698120117 nb_pixel_total : 263912 time to create 1 rle with new method : 0.015879154205322266 length of segment : 819 time for calcul the mask position with numpy : 0.0004210472106933594 nb_pixel_total : 22877 time to create 1 rle with old method : 0.0264589786529541 length of segment : 257 time for calcul the mask position with numpy : 0.0005383491516113281 nb_pixel_total : 32957 time to create 1 rle with old method : 0.036934852600097656 length of segment : 264 time for calcul the mask position with numpy : 0.0011682510375976562 nb_pixel_total : 66226 time to create 1 rle with old method : 0.0773465633392334 length of segment : 223 time for calcul the mask position with numpy : 0.0004680156707763672 nb_pixel_total : 10326 time to create 1 rle with old method : 0.013564109802246094 length of segment : 289 time for calcul the mask position with numpy : 0.004308223724365234 nb_pixel_total : 298807 time to create 1 rle with new method : 0.02275681495666504 length of segment : 804 time for calcul the mask position with numpy : 0.0004267692565917969 nb_pixel_total : 26029 time to create 1 rle with old method : 0.029301881790161133 length of segment : 205 time for calcul the mask position with numpy : 0.0008282661437988281 nb_pixel_total : 40251 time to create 1 rle with old method : 0.04416656494140625 length of segment : 226 time for calcul the mask position with numpy : 0.0030510425567626953 nb_pixel_total : 173539 time to create 1 rle with new method : 0.008266448974609375 length of segment : 390 time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 36051 time to create 1 rle with old method : 0.03862786293029785 length of segment : 256 time for calcul the mask position with numpy : 0.0007672309875488281 nb_pixel_total : 31577 time to create 1 rle with old method : 0.03404831886291504 length of segment : 255 time for calcul the mask position with numpy : 0.0007300376892089844 nb_pixel_total : 32304 time to create 1 rle with old method : 0.03461337089538574 length of segment : 291 time for calcul the mask position with numpy : 0.0010271072387695312 nb_pixel_total : 74940 time to create 1 rle with old method : 0.07791566848754883 length of segment : 302 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 12427 time to create 1 rle with old method : 0.013371944427490234 length of segment : 188 time for calcul the mask position with numpy : 0.0022323131561279297 nb_pixel_total : 152626 time to create 1 rle with new method : 0.009586572647094727 length of segment : 537 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 23750 time to create 1 rle with old method : 0.025481462478637695 length of segment : 176 time for calcul the mask position with numpy : 0.0010499954223632812 nb_pixel_total : 75518 time to create 1 rle with old method : 0.07895636558532715 length of segment : 279 time for calcul the mask position with numpy : 0.0005710124969482422 nb_pixel_total : 33445 time to create 1 rle with old method : 0.035964250564575195 length of segment : 271 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 33828 time to create 1 rle with old method : 0.03621411323547363 length of segment : 241 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 19413 time to create 1 rle with old method : 0.02073192596435547 length of segment : 139 time for calcul the mask position with numpy : 0.0005223751068115234 nb_pixel_total : 28563 time to create 1 rle with old method : 0.030429840087890625 length of segment : 207 time for calcul the mask position with numpy : 0.0018146038055419922 nb_pixel_total : 133007 time to create 1 rle with old method : 0.13816046714782715 length of segment : 481 time for calcul the mask position with numpy : 0.000522613525390625 nb_pixel_total : 35028 time to create 1 rle with old method : 0.03696727752685547 length of segment : 207 time for calcul the mask position with numpy : 0.00055694580078125 nb_pixel_total : 26390 time to create 1 rle with old method : 0.028369426727294922 length of segment : 212 time for calcul the mask position with numpy : 0.0017702579498291016 nb_pixel_total : 127458 time to create 1 rle with old method : 0.13184642791748047 length of segment : 474 time for calcul the mask position with numpy : 0.0007054805755615234 nb_pixel_total : 44826 time to create 1 rle with old method : 0.046530961990356445 length of segment : 447 time for calcul the mask position with numpy : 0.0004494190216064453 nb_pixel_total : 27740 time to create 1 rle with old method : 0.02876114845275879 length of segment : 230 time for calcul the mask position with numpy : 0.00026869773864746094 nb_pixel_total : 14150 time to create 1 rle with old method : 0.014989614486694336 length of segment : 162 time for calcul the mask position with numpy : 0.0008478164672851562 nb_pixel_total : 64977 time to create 1 rle with old method : 0.06830501556396484 length of segment : 185 time for calcul the mask position with numpy : 0.00048613548278808594 nb_pixel_total : 29129 time to create 1 rle with old method : 0.030205965042114258 length of segment : 200 time for calcul the mask position with numpy : 0.0005183219909667969 nb_pixel_total : 29251 time to create 1 rle with old method : 0.030749082565307617 length of segment : 245 time for calcul the mask position with numpy : 0.0009157657623291016 nb_pixel_total : 59641 time to create 1 rle with old method : 0.06190657615661621 length of segment : 248 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 21847 time to create 1 rle with old method : 0.023257970809936523 length of segment : 205 time for calcul the mask position with numpy : 0.0006136894226074219 nb_pixel_total : 37021 time to create 1 rle with old method : 0.03938627243041992 length of segment : 310 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 31925 time to create 1 rle with old method : 0.03861641883850098 length of segment : 184 time for calcul the mask position with numpy : 0.0005972385406494141 nb_pixel_total : 30109 time to create 1 rle with old method : 0.032320261001586914 length of segment : 208 time for calcul the mask position with numpy : 0.001094818115234375 nb_pixel_total : 81762 time to create 1 rle with old method : 0.08473730087280273 length of segment : 299 time for calcul the mask position with numpy : 0.0024182796478271484 nb_pixel_total : 159691 time to create 1 rle with new method : 0.00980520248413086 length of segment : 565 time for calcul the mask position with numpy : 0.0005495548248291016 nb_pixel_total : 17573 time to create 1 rle with old method : 0.018275976181030273 length of segment : 131 time for calcul the mask position with numpy : 0.001722574234008789 nb_pixel_total : 56707 time to create 1 rle with old method : 0.05895066261291504 length of segment : 456 time for calcul the mask position with numpy : 0.0005464553833007812 nb_pixel_total : 18753 time to create 1 rle with old method : 0.019606351852416992 length of segment : 141 time for calcul the mask position with numpy : 0.0020072460174560547 nb_pixel_total : 73797 time to create 1 rle with old method : 0.0827183723449707 length of segment : 382 time for calcul the mask position with numpy : 0.0014984607696533203 nb_pixel_total : 41389 time to create 1 rle with old method : 0.04328322410583496 length of segment : 209 time for calcul the mask position with numpy : 0.0008275508880615234 nb_pixel_total : 25344 time to create 1 rle with old method : 0.026320219039916992 length of segment : 257 time for calcul the mask position with numpy : 0.003432035446166992 nb_pixel_total : 144172 time to create 1 rle with old method : 0.15203452110290527 length of segment : 433 time for calcul the mask position with numpy : 0.004212141036987305 nb_pixel_total : 161832 time to create 1 rle with new method : 0.009566307067871094 length of segment : 394 time for calcul the mask position with numpy : 0.0011038780212402344 nb_pixel_total : 28873 time to create 1 rle with old method : 0.030063867568969727 length of segment : 234 time for calcul the mask position with numpy : 0.004601478576660156 nb_pixel_total : 201144 time to create 1 rle with new method : 0.012121915817260742 length of segment : 433 time for calcul the mask position with numpy : 0.0009126663208007812 nb_pixel_total : 28671 time to create 1 rle with old method : 0.030698299407958984 length of segment : 146 time for calcul the mask position with numpy : 0.0006167888641357422 nb_pixel_total : 17903 time to create 1 rle with old method : 0.019164085388183594 length of segment : 133 time for calcul the mask position with numpy : 0.0004029273986816406 nb_pixel_total : 28430 time to create 1 rle with old method : 0.030262231826782227 length of segment : 141 time spent for convertir_results : 7.385464429855347 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 83 chid ids of type : 3594 Number RLEs to save : 22549 save missing photos in datou_result : time spend for datou_step_exec : 75.44045495986938 time spend to save output : 2.409513473510742 total time spend for step 1 : 77.84996843338013 step2:crop_condition Tue Oct 7 10:51:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 83 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759827126_2274945 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214555_0.png', 0, 188, 224, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214552_0.png', 0, 532, 522, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214554_0.png', 0, 204, 195, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214562_0.png', 0, 176, 202, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214558_0.png', 0, 225, 131, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214560_0.png', 0, 306, 82, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214559_0.png', 0, 112, 97, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214565_0.png', 0, 496, 399, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214567_0.png', 0, 180, 226, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214569_0.png', 0, 447, 336, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214579_0.png', 0, 318, 201, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214578_0.png', 0, 199, 61, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214577_0.png', 0, 89, 87, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214576_0.png', 0, 372, 353, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214585_0.png', 0, 385, 213, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214583_0.png', 0, 142, 257, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214586_0.png', 0, 58, 302, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214588_0.png', 0, 191, 205, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214592_0.png', 0, 257, 255, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214591_0.png', 0, 187, 235, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214595_0.png', 0, 94, 186, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214593_0.png', 0, 267, 291, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214600_0.png', 0, 182, 240, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214602_0.png', 0, 348, 182, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214601_0.png', 0, 188, 138, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214603_0.png', 0, 432, 461, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214606_0.png', 0, 341, 473, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214608_0.png', 0, 146, 230, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214607_0.png', 0, 113, 446, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214617_0.png', 0, 330, 193, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214619_0.png', 0, 415, 565, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214625_0.png', 0, 117, 257, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214623_0.png', 0, 269, 379, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827134), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214630_0.png', 0, 243, 146, 0, 1759827134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 14.23586130142212 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759827143_2274945 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214580_0.png', 0, 155, 158, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214589_0.png', 0, 283, 211, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214594_0.png', 0, 320, 298, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214614_0.png', 0, 196, 172, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214616_0.png', 0, 219, 179, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214613_0.png', 0, 363, 247, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214615_0.png', 0, 178, 310, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214620_0.png', 0, 169, 131, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214622_0.png', 0, 165, 138, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214628_0.png', 0, 189, 216, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827146), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214632_0.png', 0, 243, 141, 0, 1759827146,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.684727191925049 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759827150_2274945 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827150), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214561_0.png', 0, 78, 106, 0, 1759827150,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827150), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214563_0.png', 0, 148, 182, 0, 1759827150,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827150), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214573_0.png', 0, 193, 121, 0, 1759827150,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827150), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214631_0.png', 0, 240, 103, 0, 1759827150,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.362541913986206 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759827165_2274945 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214551_0.png', 0, 333, 157, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214550_0.png', 0, 353, 222, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214553_0.png', 0, 322, 259, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214557_0.png', 0, 469, 360, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214556_0.png', 0, 444, 229, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214564_0.png', 0, 138, 189, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214566_0.png', 0, 277, 369, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214568_0.png', 0, 336, 546, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214570_0.png', 0, 251, 160, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214571_0.png', 0, 187, 285, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214581_0.png', 0, 206, 399, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214575_0.png', 0, 370, 169, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214587_0.png', 0, 577, 802, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214582_0.png', 0, 823, 547, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214584_0.png', 0, 178, 264, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214590_0.png', 0, 539, 390, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214596_0.png', 0, 395, 533, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214598_0.png', 0, 352, 276, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214599_0.png', 0, 208, 236, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214610_0.png', 0, 452, 181, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214612_0.png', 0, 162, 245, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214609_0.png', 0, 131, 161, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214618_0.png', 0, 417, 298, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214621_0.png', 0, 271, 403, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214626_0.png', 0, 589, 384, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214629_0.png', 0, 689, 433, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214624_0.png', 0, 352, 192, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827171), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214627_0.png', 0, 607, 392, 0, 1759827171,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.97298288345337 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759827177_2274945 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827178), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214572_0.png', 0, 130, 138, 0, 1759827178,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827178), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214574_0.png', 0, 267, 174, 0, 1759827178,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827178), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214597_0.png', 0, 189, 175, 0, 1759827178,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827178), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214604_0.png', 0, 218, 196, 0, 1759827178,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827178), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214605_0.png', 0, 166, 194, 0, 1759827178,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759827178), 0.0, 0.0, 14, '', 0, 0, '1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214611_0.png', 0, 218, 200, 0, 1759827178,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9615745544433594 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1387757578, 1387757560, 1387757559, 1387757556, 1387757552, 1387757549, 1387757546, 1387757532, 1387757530, 1387757527, 1387757523, 1387757518, 1387757514] Looping around the photos to save general results len do output : 83 /1387930828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387930991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387931326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757578', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757560', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757559', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757556', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757552', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757549', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757546', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757532', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757530', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757527', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757523', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757518', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757514', None, None, None, None, None, '3866639') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 262 time used for this insertion : 0.04392743110656738 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.24308514595032 time spend to save output : 0.05076742172241211 total time spend for step 2 : 67.29385256767273 step3:rle_unique_nms_with_priority Tue Oct 7 10:52:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 83 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.693162679672241 time for calcul the mask position with numpy : 0.6919388771057129 nb_pixel_total : 7899448 time to create 1 rle with new method : 0.9812836647033691 time for calcul the mask position with numpy : 0.025172948837280273 nb_pixel_total : 30406 time to create 1 rle with old method : 0.0452573299407959 time for calcul the mask position with numpy : 0.02616572380065918 nb_pixel_total : 20999 time to create 1 rle with old method : 0.02789473533630371 time for calcul the mask position with numpy : 0.025644540786743164 nb_pixel_total : 61074 time to create 1 rle with old method : 0.06991147994995117 time for calcul the mask position with numpy : 0.026226282119750977 nb_pixel_total : 178582 time to create 1 rle with new method : 0.752161979675293 time for calcul the mask position with numpy : 0.02447056770324707 nb_pixel_total : 40189 time to create 1 rle with old method : 0.04502129554748535 time for calcul the mask position with numpy : 0.024525165557861328 nb_pixel_total : 63702 time to create 1 rle with old method : 0.06896615028381348 create new chi : 2.9052841663360596 time to delete rle : 0.08697032928466797 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5406 TO DO : save crop sub photo not yet done ! save time : 0.6774272918701172 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.9959988594055176 time for calcul the mask position with numpy : 0.7814130783081055 nb_pixel_total : 7985984 time to create 1 rle with new method : 0.8219549655914307 time for calcul the mask position with numpy : 0.02450847625732422 nb_pixel_total : 12481 time to create 1 rle with old method : 0.013816118240356445 time for calcul the mask position with numpy : 0.024607181549072266 nb_pixel_total : 22263 time to create 1 rle with old method : 0.024234294891357422 time for calcul the mask position with numpy : 0.02445244789123535 nb_pixel_total : 18323 time to create 1 rle with old method : 0.020540714263916016 time for calcul the mask position with numpy : 0.0242464542388916 nb_pixel_total : 5894 time to create 1 rle with old method : 0.006394386291503906 time for calcul the mask position with numpy : 0.024147748947143555 nb_pixel_total : 17870 time to create 1 rle with old method : 0.019573688507080078 time for calcul the mask position with numpy : 0.024239540100097656 nb_pixel_total : 8209 time to create 1 rle with old method : 0.00914907455444336 time for calcul the mask position with numpy : 0.025719642639160156 nb_pixel_total : 21551 time to create 1 rle with old method : 0.024169921875 time for calcul the mask position with numpy : 0.02606678009033203 nb_pixel_total : 133276 time to create 1 rle with old method : 0.14735078811645508 time for calcul the mask position with numpy : 0.025740861892700195 nb_pixel_total : 68549 time to create 1 rle with old method : 0.07668066024780273 create new chi : 2.2148094177246094 time to delete rle : 0.0007853507995605469 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++Number RLEs to save : 5566 TO DO : save crop sub photo not yet done ! save time : 0.7311656475067139 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.7037665843963623 time for calcul the mask position with numpy : 0.2781538963317871 nb_pixel_total : 7921920 time to create 1 rle with new method : 0.7874045372009277 time for calcul the mask position with numpy : 0.026980161666870117 nb_pixel_total : 134827 time to create 1 rle with old method : 0.14926433563232422 time for calcul the mask position with numpy : 0.02546072006225586 nb_pixel_total : 24702 time to create 1 rle with old method : 0.02741408348083496 time for calcul the mask position with numpy : 0.024998188018798828 nb_pixel_total : 89201 time to create 1 rle with old method : 0.09900617599487305 time for calcul the mask position with numpy : 0.0255889892578125 nb_pixel_total : 123750 time to create 1 rle with old method : 0.1408531665802002 create new chi : 1.6336424350738525 time to delete rle : 0.0013537406921386719 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 5320 TO DO : save crop sub photo not yet done ! save time : 0.7106311321258545 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 3.8577089309692383 time for calcul the mask position with numpy : 1.737903118133545 nb_pixel_total : 8070083 time to create 1 rle with new method : 0.936018705368042 time for calcul the mask position with numpy : 0.02860236167907715 nb_pixel_total : 34590 time to create 1 rle with old method : 0.053414106369018555 time for calcul the mask position with numpy : 0.026305675506591797 nb_pixel_total : 19276 time to create 1 rle with old method : 0.02339649200439453 time for calcul the mask position with numpy : 0.02547287940979004 nb_pixel_total : 14600 time to create 1 rle with old method : 0.016315937042236328 time for calcul the mask position with numpy : 0.02520132064819336 nb_pixel_total : 28649 time to create 1 rle with old method : 0.03188061714172363 time for calcul the mask position with numpy : 0.025389671325683594 nb_pixel_total : 29192 time to create 1 rle with old method : 0.0324404239654541 time for calcul the mask position with numpy : 0.026880741119384766 nb_pixel_total : 98010 time to create 1 rle with old method : 0.10804438591003418 create new chi : 3.151285409927368 time to delete rle : 0.0008275508880615234 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 4622 TO DO : save crop sub photo not yet done ! save time : 0.6544163227081299 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.524935483932495 time for calcul the mask position with numpy : 0.7978396415710449 nb_pixel_total : 8034987 time to create 1 rle with new method : 0.9999203681945801 time for calcul the mask position with numpy : 0.027165889739990234 nb_pixel_total : 53863 time to create 1 rle with old method : 0.06376528739929199 time for calcul the mask position with numpy : 0.02570199966430664 nb_pixel_total : 17053 time to create 1 rle with old method : 0.01894521713256836 time for calcul the mask position with numpy : 0.025936365127563477 nb_pixel_total : 39839 time to create 1 rle with old method : 0.04589080810546875 time for calcul the mask position with numpy : 0.023961782455444336 nb_pixel_total : 8617 time to create 1 rle with old method : 0.009644508361816406 time for calcul the mask position with numpy : 0.023899316787719727 nb_pixel_total : 6531 time to create 1 rle with old method : 0.007569074630737305 time for calcul the mask position with numpy : 0.024797916412353516 nb_pixel_total : 78457 time to create 1 rle with old method : 0.09361767768859863 time for calcul the mask position with numpy : 0.0259249210357666 nb_pixel_total : 55053 time to create 1 rle with old method : 0.060510873794555664 create new chi : 2.3437533378601074 time to delete rle : 0.0008015632629394531 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5040 TO DO : save crop sub photo not yet done ! save time : 0.6811161041259766 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.7979838848114014 time for calcul the mask position with numpy : 0.42617177963256836 nb_pixel_total : 7573266 time to create 1 rle with new method : 0.8299691677093506 time for calcul the mask position with numpy : 0.027036190032958984 nb_pixel_total : 26029 time to create 1 rle with old method : 0.031267404556274414 time for calcul the mask position with numpy : 0.027817964553833008 nb_pixel_total : 298807 time to create 1 rle with new method : 0.6914064884185791 time for calcul the mask position with numpy : 0.024486780166625977 nb_pixel_total : 10326 time to create 1 rle with old method : 0.01161503791809082 time for calcul the mask position with numpy : 0.024669885635375977 nb_pixel_total : 66226 time to create 1 rle with old method : 0.0735931396484375 time for calcul the mask position with numpy : 0.024528026580810547 nb_pixel_total : 32957 time to create 1 rle with old method : 0.03687262535095215 time for calcul the mask position with numpy : 0.024428129196166992 nb_pixel_total : 22877 time to create 1 rle with old method : 0.025791645050048828 time for calcul the mask position with numpy : 0.02590036392211914 nb_pixel_total : 263912 time to create 1 rle with new method : 0.8787415027618408 create new chi : 3.29032039642334 time to delete rle : 0.0011780261993408203 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 7882 TO DO : save crop sub photo not yet done ! save time : 0.9268934726715088 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.1115214824676514 time for calcul the mask position with numpy : 0.5756466388702393 nb_pixel_total : 8012982 time to create 1 rle with new method : 1.123957633972168 time for calcul the mask position with numpy : 0.045011043548583984 nb_pixel_total : 31577 time to create 1 rle with old method : 0.037737131118774414 time for calcul the mask position with numpy : 0.04129958152770996 nb_pixel_total : 36051 time to create 1 rle with old method : 0.041723012924194336 time for calcul the mask position with numpy : 0.04436635971069336 nb_pixel_total : 173539 time to create 1 rle with new method : 0.567476749420166 time for calcul the mask position with numpy : 0.04137420654296875 nb_pixel_total : 40251 time to create 1 rle with old method : 0.04634809494018555 create new chi : 2.643721342086792 time to delete rle : 0.0008044242858886719 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4414 TO DO : save crop sub photo not yet done ! save time : 0.6024167537689209 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.727680206298828 time for calcul the mask position with numpy : 0.7835979461669922 nb_pixel_total : 7855562 time to create 1 rle with new method : 1.117149829864502 time for calcul the mask position with numpy : 0.04492664337158203 nb_pixel_total : 33828 time to create 1 rle with old method : 0.05205345153808594 time for calcul the mask position with numpy : 0.03095388412475586 nb_pixel_total : 33445 time to create 1 rle with old method : 0.037109375 time for calcul the mask position with numpy : 0.0254361629486084 nb_pixel_total : 75518 time to create 1 rle with old method : 0.0834653377532959 time for calcul the mask position with numpy : 0.0249025821685791 nb_pixel_total : 23750 time to create 1 rle with old method : 0.026712894439697266 time for calcul the mask position with numpy : 0.02578139305114746 nb_pixel_total : 152626 time to create 1 rle with new method : 0.6870408058166504 time for calcul the mask position with numpy : 0.025509357452392578 nb_pixel_total : 12427 time to create 1 rle with old method : 0.01410531997680664 time for calcul the mask position with numpy : 0.02569866180419922 nb_pixel_total : 74940 time to create 1 rle with old method : 0.08423924446105957 time for calcul the mask position with numpy : 0.02527141571044922 nb_pixel_total : 32304 time to create 1 rle with old method : 0.04750847816467285 create new chi : 3.244647264480591 time to delete rle : 0.0016281604766845703 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 6730 TO DO : save crop sub photo not yet done ! save time : 0.8363521099090576 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.0724289417266846 time for calcul the mask position with numpy : 0.6112747192382812 nb_pixel_total : 8078389 time to create 1 rle with new method : 0.9965200424194336 time for calcul the mask position with numpy : 0.040955305099487305 nb_pixel_total : 35028 time to create 1 rle with old method : 0.03815484046936035 time for calcul the mask position with numpy : 0.03873419761657715 nb_pixel_total : 133007 time to create 1 rle with old method : 0.14475154876708984 time for calcul the mask position with numpy : 0.02465200424194336 nb_pixel_total : 28563 time to create 1 rle with old method : 0.03189206123352051 time for calcul the mask position with numpy : 0.03250765800476074 nb_pixel_total : 19413 time to create 1 rle with old method : 0.02234339714050293 create new chi : 2.0291566848754883 time to delete rle : 0.0007472038269042969 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4228 TO DO : save crop sub photo not yet done ! save time : 0.651357889175415 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.1746838092803955 time for calcul the mask position with numpy : 0.8146383762359619 nb_pixel_total : 7930479 time to create 1 rle with new method : 1.861490249633789 time for calcul the mask position with numpy : 0.024773359298706055 nb_pixel_total : 29251 time to create 1 rle with old method : 0.031826019287109375 time for calcul the mask position with numpy : 0.024947166442871094 nb_pixel_total : 29129 time to create 1 rle with old method : 0.03253579139709473 time for calcul the mask position with numpy : 0.025982379913330078 nb_pixel_total : 64977 time to create 1 rle with old method : 0.07302069664001465 time for calcul the mask position with numpy : 0.02440023422241211 nb_pixel_total : 14150 time to create 1 rle with old method : 0.0158846378326416 time for calcul the mask position with numpy : 0.024695158004760742 nb_pixel_total : 27740 time to create 1 rle with old method : 0.031168222427368164 time for calcul the mask position with numpy : 0.024776220321655273 nb_pixel_total : 44826 time to create 1 rle with old method : 0.05126667022705078 time for calcul the mask position with numpy : 0.027195453643798828 nb_pixel_total : 127458 time to create 1 rle with old method : 0.146406888961792 time for calcul the mask position with numpy : 0.04233694076538086 nb_pixel_total : 26390 time to create 1 rle with old method : 0.030436038970947266 create new chi : 3.35489821434021 time to delete rle : 0.012645483016967773 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6470 TO DO : save crop sub photo not yet done ! save time : 0.7763793468475342 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 1.9683465957641602 time for calcul the mask position with numpy : 0.2851269245147705 nb_pixel_total : 8113857 time to create 1 rle with new method : 0.7214264869689941 time for calcul the mask position with numpy : 0.024199962615966797 nb_pixel_total : 30109 time to create 1 rle with old method : 0.032970428466796875 time for calcul the mask position with numpy : 0.024557828903198242 nb_pixel_total : 31925 time to create 1 rle with old method : 0.035587310791015625 time for calcul the mask position with numpy : 0.04052734375 nb_pixel_total : 37021 time to create 1 rle with old method : 0.04327106475830078 time for calcul the mask position with numpy : 0.041286468505859375 nb_pixel_total : 21847 time to create 1 rle with old method : 0.024336576461791992 time for calcul the mask position with numpy : 0.043348073959350586 nb_pixel_total : 59641 time to create 1 rle with old method : 0.06598544120788574 create new chi : 1.430772304534912 time to delete rle : 0.0006814002990722656 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4470 TO DO : save crop sub photo not yet done ! save time : 0.5928421020507812 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.021548271179199 time for calcul the mask position with numpy : 0.6840238571166992 nb_pixel_total : 7959914 time to create 1 rle with new method : 0.9265720844268799 time for calcul the mask position with numpy : 0.04056286811828613 nb_pixel_total : 18753 time to create 1 rle with old method : 0.02075028419494629 time for calcul the mask position with numpy : 0.038572072982788086 nb_pixel_total : 56707 time to create 1 rle with old method : 0.06126713752746582 time for calcul the mask position with numpy : 0.02404046058654785 nb_pixel_total : 17573 time to create 1 rle with old method : 0.01933884620666504 time for calcul the mask position with numpy : 0.026991844177246094 nb_pixel_total : 159691 time to create 1 rle with new method : 0.5342185497283936 time for calcul the mask position with numpy : 0.024311542510986328 nb_pixel_total : 81762 time to create 1 rle with old method : 0.08849263191223145 create new chi : 2.564526081085205 time to delete rle : 0.0007941722869873047 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5344 TO DO : save crop sub photo not yet done ! save time : 0.6773808002471924 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 3.7693285942077637 time for calcul the mask position with numpy : 0.5845708847045898 nb_pixel_total : 7570951 time to create 1 rle with new method : 0.7854740619659424 time for calcul the mask position with numpy : 0.03942728042602539 nb_pixel_total : 324 time to create 1 rle with old method : 0.0006520748138427734 time for calcul the mask position with numpy : 0.02440333366394043 nb_pixel_total : 17903 time to create 1 rle with old method : 0.019436120986938477 time for calcul the mask position with numpy : 0.0235135555267334 nb_pixel_total : 28671 time to create 1 rle with old method : 0.036771297454833984 time for calcul the mask position with numpy : 0.027178525924682617 nb_pixel_total : 201144 time to create 1 rle with new method : 0.5931484699249268 time for calcul the mask position with numpy : 0.025306224822998047 nb_pixel_total : 28873 time to create 1 rle with old method : 0.03844118118286133 time for calcul the mask position with numpy : 0.026140928268432617 nb_pixel_total : 161832 time to create 1 rle with new method : 0.49741482734680176 time for calcul the mask position with numpy : 0.0269467830657959 nb_pixel_total : 144172 time to create 1 rle with old method : 0.1591644287109375 time for calcul the mask position with numpy : 0.02482151985168457 nb_pixel_total : 25344 time to create 1 rle with old method : 0.027753353118896484 time for calcul the mask position with numpy : 0.023886680603027344 nb_pixel_total : 41389 time to create 1 rle with old method : 0.04455447196960449 time for calcul the mask position with numpy : 0.02410578727722168 nb_pixel_total : 73797 time to create 1 rle with old method : 0.08005833625793457 create new chi : 3.2381510734558105 time to delete rle : 0.0011370182037353516 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 7566 TO DO : save crop sub photo not yet done ! save time : 0.9154520034790039 map_output_result : {1387757578: (0.0, 'Should be the crop_list due to order', 0), 1387757560: (0.0, 'Should be the crop_list due to order', 0), 1387757559: (0.0, 'Should be the crop_list due to order', 0), 1387757556: (0.0, 'Should be the crop_list due to order', 0), 1387757552: (0.0, 'Should be the crop_list due to order', 0), 1387757549: (0.0, 'Should be the crop_list due to order', 0), 1387757546: (0.0, 'Should be the crop_list due to order', 0), 1387757532: (0.0, 'Should be the crop_list due to order', 0), 1387757530: (0.0, 'Should be the crop_list due to order', 0), 1387757527: (0.0, 'Should be the crop_list due to order', 0), 1387757523: (0.0, 'Should be the crop_list due to order', 0), 1387757518: (0.0, 'Should be the crop_list due to order', 0), 1387757514: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1387757578, 1387757560, 1387757559, 1387757556, 1387757552, 1387757549, 1387757546, 1387757532, 1387757530, 1387757527, 1387757523, 1387757518, 1387757514] Looping around the photos to save general results len do output : 13 /1387757578.Didn't retrieve data . /1387757560.Didn't retrieve data . /1387757559.Didn't retrieve data . /1387757556.Didn't retrieve data . /1387757552.Didn't retrieve data . /1387757549.Didn't retrieve data . /1387757546.Didn't retrieve data . /1387757532.Didn't retrieve data . /1387757530.Didn't retrieve data . /1387757527.Didn't retrieve data . /1387757523.Didn't retrieve data . /1387757518.Didn't retrieve data . /1387757514.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757578', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757560', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757559', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757556', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757552', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757549', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757546', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757532', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757530', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757527', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757523', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757518', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757514', None, None, None, None, None, '3866639') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.03708481788635254 save_final save missing photos in datou_result : time spend for datou_step_exec : 86.76468181610107 time spend to save output : 0.055082082748413086 total time spend for step 3 : 86.81976389884949 step4:ventilate_hashtags_in_portfolio Tue Oct 7 10:54:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27552574 get user id for portfolio 27552574 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27552574 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','pet_clair','pehd','pet_fonce','environnement','carton','mal_croppe','flou','papier','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27552574 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','pet_clair','pehd','pet_fonce','environnement','carton','mal_croppe','flou','papier','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27552574 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','pet_clair','pehd','pet_fonce','environnement','carton','mal_croppe','flou','papier','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27554038,27554039,27554040,27554041,27554042,27554043,27554044,27554045,27554046,27554047,27554048?tags=metal,autre,pet_clair,pehd,pet_fonce,environnement,carton,mal_croppe,flou,papier,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1387757578, 1387757560, 1387757559, 1387757556, 1387757552, 1387757549, 1387757546, 1387757532, 1387757530, 1387757527, 1387757523, 1387757518, 1387757514] Looping around the photos to save general results len do output : 1 /27552574. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757578', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757560', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757559', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757556', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757552', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757549', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757546', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757532', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757530', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757527', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757523', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757518', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757514', None, None, None, None, None, '3866639') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.03637099266052246 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.485426187515259 time spend to save output : 0.047235965728759766 total time spend for step 4 : 5.5326621532440186 step5:final Tue Oct 7 10:54:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1387757578: ('0.04469538298314339',), 1387757560: ('0.04469538298314339',), 1387757559: ('0.04469538298314339',), 1387757556: ('0.04469538298314339',), 1387757552: ('0.04469538298314339',), 1387757549: ('0.04469538298314339',), 1387757546: ('0.04469538298314339',), 1387757532: ('0.04469538298314339',), 1387757530: ('0.04469538298314339',), 1387757527: ('0.04469538298314339',), 1387757523: ('0.04469538298314339',), 1387757518: ('0.04469538298314339',), 1387757514: ('0.04469538298314339',)} new output for save of step final : {1387757578: ('0.04469538298314339',), 1387757560: ('0.04469538298314339',), 1387757559: ('0.04469538298314339',), 1387757556: ('0.04469538298314339',), 1387757552: ('0.04469538298314339',), 1387757549: ('0.04469538298314339',), 1387757546: ('0.04469538298314339',), 1387757532: ('0.04469538298314339',), 1387757530: ('0.04469538298314339',), 1387757527: ('0.04469538298314339',), 1387757523: ('0.04469538298314339',), 1387757518: ('0.04469538298314339',), 1387757514: ('0.04469538298314339',)} [1387757578, 1387757560, 1387757559, 1387757556, 1387757552, 1387757549, 1387757546, 1387757532, 1387757530, 1387757527, 1387757523, 1387757518, 1387757514] Looping around the photos to save general results len do output : 13 /1387757578.Didn't retrieve data . /1387757560.Didn't retrieve data . /1387757559.Didn't retrieve data . /1387757556.Didn't retrieve data . /1387757552.Didn't retrieve data . /1387757549.Didn't retrieve data . /1387757546.Didn't retrieve data . /1387757532.Didn't retrieve data . /1387757530.Didn't retrieve data . /1387757527.Didn't retrieve data . /1387757523.Didn't retrieve data . /1387757518.Didn't retrieve data . /1387757514.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757578', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757560', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757559', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757556', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757552', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757549', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757546', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757532', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757530', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757527', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757523', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757518', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757514', None, None, None, None, None, '3866639') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.0360255241394043 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3835031986236572 time spend to save output : 0.037235260009765625 total time spend for step 5 : 0.42073845863342285 step6:blur_detection Tue Oct 7 10:54:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6.jpg resize: (2160, 3840) 1387757578 -5.753941704179917 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064.jpg resize: (2160, 3840) 1387757560 -7.026431374714511 treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1.jpg resize: (2160, 3840) 1387757559 -7.200972776036583 treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782.jpg resize: (2160, 3840) 1387757556 -7.1606201410573025 treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c.jpg resize: (2160, 3840) 1387757552 -6.890552245276118 treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4.jpg resize: (2160, 3840) 1387757549 -7.014914703557785 treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2.jpg resize: (2160, 3840) 1387757546 -6.956636274616181 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41.jpg resize: (2160, 3840) 1387757532 -7.022769418611264 treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62.jpg resize: (2160, 3840) 1387757530 -7.253702374078645 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb.jpg resize: (2160, 3840) 1387757527 -7.100145298016664 treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532.jpg resize: (2160, 3840) 1387757523 -7.0264154573293505 treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8.jpg resize: (2160, 3840) 1387757518 -7.007675119126221 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f.jpg resize: (2160, 3840) 1387757514 -6.2404604710870055 treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214555_0.png resize: (224, 188) 1387930828 -4.902518114438346 treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214552_0.png resize: (522, 532) 1387930830 -5.385916568492593 treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214554_0.png resize: (195, 204) 1387930832 -4.24464402637383 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214562_0.png resize: (202, 176) 1387930835 -3.5512707800396486 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214558_0.png resize: (131, 225) 1387930837 -3.777914743115601 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214560_0.png resize: (82, 306) 1387930839 -4.6158090238212495 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214559_0.png resize: (97, 112) 1387930841 -3.685880115848906 treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214565_0.png resize: (399, 496) 1387930843 -3.2383327309660412 treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214567_0.png resize: (226, 180) 1387930845 -4.349399613148602 treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214569_0.png resize: (336, 447) 1387930847 -3.511985323854547 treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214579_0.png resize: (201, 318) 1387930849 -4.528129238720671 treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214578_0.png resize: (61, 199) 1387930851 -2.395856293096481 treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214577_0.png resize: (87, 89) 1387930853 -3.5382077899127906 treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214576_0.png resize: (353, 372) 1387930855 -3.9870300539112913 treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214585_0.png resize: (213, 385) 1387930857 -4.091007456429386 treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214583_0.png resize: (257, 142) 1387930858 -4.471164990396887 treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214586_0.png resize: (302, 58) 1387930860 -3.9313662091489827 treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214588_0.png resize: (205, 191) 1387930862 -4.863831775010344 treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214592_0.png resize: (255, 257) 1387930864 -4.293992797257773 treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214591_0.png resize: (235, 187) 1387930866 -3.834219324763 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214595_0.png resize: (186, 94) 1387930868 -3.231044695248404 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214593_0.png resize: (291, 267) 1387930870 -3.1999930054332544 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214600_0.png resize: (240, 182) 1387930872 -4.242504349989319 treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214602_0.png resize: (182, 348) 1387930874 -4.216685555810078 treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214601_0.png resize: (138, 188) 1387930876 -3.485538559977623 treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214603_0.png resize: (461, 432) 1387930878 -3.5618196550988066 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214606_0.png resize: (473, 341) 1387930880 -5.421245563568161 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214608_0.png resize: (230, 146) 1387930882 -3.8054808258273822 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214607_0.png resize: (446, 113) 1387930885 -3.840762730802727 treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214617_0.png resize: (193, 330) 1387930887 -4.104401588218745 treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214619_0.png resize: (565, 415) 1387930889 -4.312517140831307 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214625_0.png resize: (257, 117) 1387930892 -4.102839702115126 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214623_0.png resize: (379, 269) 1387930894 -4.391833237374259 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214630_0.png resize: (146, 243) 1387930896 -2.2087023840290665 treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214580_0.png resize: (158, 155) 1387930970 -3.4113351481746204 treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214589_0.png resize: (211, 283) 1387930972 -2.566934541597575 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214594_0.png resize: (298, 320) 1387930974 -3.6878149981206145 treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214614_0.png resize: (172, 196) 1387930977 -3.36195603971585 treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214616_0.png resize: (179, 219) 1387930979 -4.797086112200775 treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214613_0.png resize: (247, 363) 1387930981 -4.239177435533136 treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214615_0.png resize: (310, 178) 1387930983 -3.904141682257102 treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214620_0.png resize: (131, 169) 1387930985 -4.09257801589595 treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214622_0.png resize: (138, 165) 1387930987 -3.4980804850987224 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214628_0.png resize: (216, 189) 1387930989 -3.9025710729517296 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214632_0.png resize: (141, 243) 1387930991 -2.1038836155634097 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214561_0.png resize: (106, 78) 1387931024 -4.3703344593822635 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214563_0.png resize: (182, 148) 1387931026 -4.703101865433508 treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214573_0.png resize: (121, 193) 1387931028 -3.457472744777775 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214631_0.png resize: (103, 240) 1387931030 -4.597661992228983 treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214551_0.png resize: (157, 333) 1387931222 -5.499636587192587 treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214550_0.png resize: (222, 353) 1387931224 -5.244235198760692 treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214553_0.png resize: (259, 322) 1387931226 -5.384129433493222 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214557_0.png resize: (360, 469) 1387931228 -5.066319428542129 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214556_0.png resize: (229, 444) 1387931230 -4.583597757307476 treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214564_0.png resize: (189, 138) 1387931231 -4.878752980778732 treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214566_0.png resize: (369, 277) 1387931233 -5.1901886654457305 treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214568_0.png resize: (546, 336) 1387931235 -5.069959479024364 treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214570_0.png resize: (160, 251) 1387931237 -4.3712777594617975 treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214571_0.png resize: (285, 187) 1387931239 -4.427108697692096 treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214581_0.png resize: (399, 206) 1387931241 -4.988014571085933 treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214575_0.png resize: (169, 370) 1387931243 -4.543385521697793 treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214587_0.png resize: (802, 577) 1387931245 -4.689099345987477 treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214582_0.png resize: (547, 823) 1387931247 -4.255966208748792 treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214584_0.png resize: (264, 178) 1387931249 -4.46930561330825 treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214590_0.png resize: (390, 539) 1387931251 -5.849954765061681 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214596_0.png resize: (533, 395) 1387931253 -5.301169127209046 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214598_0.png resize: (276, 352) 1387931255 -3.377673277724598 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214599_0.png resize: (236, 208) 1387931257 -4.869956649424214 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214610_0.png resize: (181, 452) 1387931259 -3.185143415923513 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214612_0.png resize: (245, 162) 1387931261 -4.228111568437531 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214609_0.png resize: (161, 131) 1387931263 -3.6300173132932914 treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214618_0.png resize: (298, 417) 1387931265 -3.9912005393426018 treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214621_0.png resize: (403, 271) 1387931267 -3.9937172415972744 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214626_0.png resize: (384, 589) 1387931269 -4.92427086481514 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214629_0.png resize: (433, 689) 1387931271 -2.5344024976525463 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214624_0.png resize: (192, 352) 1387931273 -4.280949947768944 treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214627_0.png resize: (392, 607) 1387931275 -4.101654641771726 treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214572_0.png resize: (138, 130) 1387931317 -4.069430896166219 treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214574_0.png resize: (174, 267) 1387931319 -4.874398089935594 treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214597_0.png resize: (175, 189) 1387931321 -5.189172036965681 treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214604_0.png resize: (196, 218) 1387931322 -3.8720415011007576 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214605_0.png resize: (194, 166) 1387931324 -3.2580637107096675 treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214611_0.png resize: (200, 218) 1387931326 -5.101194088207993 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.042893171310424805 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.03917050361633301 save missing photos in datou_result : time spend for datou_step_exec : 54.67185974121094 time spend to save output : 0.11784029006958008 total time spend for step 6 : 54.78970003128052 step7:brightness Tue Oct 7 10:55:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6.jpg treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064.jpg treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1.jpg treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782.jpg treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c.jpg treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4.jpg treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2.jpg treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41.jpg treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62.jpg treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb.jpg treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532.jpg treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8.jpg treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f.jpg treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214555_0.png treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214552_0.png treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214554_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214562_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214558_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214560_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214559_0.png treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214565_0.png treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214567_0.png treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214569_0.png treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214579_0.png treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214578_0.png treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214577_0.png treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214576_0.png treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214585_0.png treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214583_0.png treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214586_0.png treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214588_0.png treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214592_0.png treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214591_0.png treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214595_0.png treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214593_0.png treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214600_0.png treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214602_0.png treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214601_0.png treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214603_0.png treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214606_0.png treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214608_0.png treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214607_0.png treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214617_0.png treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214619_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214625_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214623_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214630_0.png treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214580_0.png treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214589_0.png treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214594_0.png treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214614_0.png treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214616_0.png treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214613_0.png treat image : temp/1759827030_2274945_1387757523_6889679678d6feebc2882ebec790b532_rle_crop_3987214615_0.png treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214620_0.png treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214622_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214628_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214632_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214561_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214563_0.png treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214573_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214631_0.png treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214551_0.png treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214550_0.png treat image : temp/1759827030_2274945_1387757578_e95108147935bc416bf2fd2773ac8ef6_rle_crop_3987214553_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214557_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214556_0.png treat image : temp/1759827030_2274945_1387757560_2eba0de4ed3048ae506308ba23512064_rle_crop_3987214564_0.png treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214566_0.png treat image : temp/1759827030_2274945_1387757559_2086dcef2d2ad11e2095c5d75aa7f0c1_rle_crop_3987214568_0.png treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214570_0.png treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214571_0.png treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214581_0.png treat image : temp/1759827030_2274945_1387757552_36c70fd8ca6c15b0efe790006b90335c_rle_crop_3987214575_0.png treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214587_0.png treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214582_0.png treat image : temp/1759827030_2274945_1387757549_be48e9bbb5b89c2d62dbd1a51f8700b4_rle_crop_3987214584_0.png treat image : temp/1759827030_2274945_1387757546_8bed46b971f16931c5098f33d2b9aeb2_rle_crop_3987214590_0.png treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214596_0.png treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214598_0.png treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214599_0.png treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214610_0.png treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214612_0.png treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214609_0.png treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214618_0.png treat image : temp/1759827030_2274945_1387757518_94487ce470c4110bb540f2c66f083fe8_rle_crop_3987214621_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214626_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214629_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214624_0.png treat image : temp/1759827030_2274945_1387757514_ebd6881d947ec8c9ab5b654c360ebd3f_rle_crop_3987214627_0.png treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214572_0.png treat image : temp/1759827030_2274945_1387757556_bdc12e84e84496572a249c10e3bc8782_rle_crop_3987214574_0.png treat image : temp/1759827030_2274945_1387757532_fdb3f7a241ec1b193274a506a1488b41_rle_crop_3987214597_0.png treat image : temp/1759827030_2274945_1387757530_44c6118b00dfa260e90c7ff33b36fd62_rle_crop_3987214604_0.png treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214605_0.png treat image : temp/1759827030_2274945_1387757527_b329fe6ec041df579e5782f6be3b7ccb_rle_crop_3987214611_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.04242277145385742 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.03832602500915527 save missing photos in datou_result : time spend for datou_step_exec : 12.596717357635498 time spend to save output : 0.09873700141906738 total time spend for step 7 : 12.695454359054565 step8:velours_tree Tue Oct 7 10:55:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.4833970069885254 time spend to save output : 4.601478576660156e-05 total time spend for step 8 : 0.483443021774292 step9:send_mail_cod Tue Oct 7 10:55:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27552574_07-10-2025_10_55_40.pdf 27554038 change filename to text .change filename to text .change filename to text .change filename to text .imagette275540381759827340 27554039 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette275540391759827340 27554040 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette275540401759827341 27554041 imagette275540411759827343 27554042 imagette275540421759827343 27554044 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette275540441759827343 27554045 imagette275540451759827344 27554046 imagette275540461759827344 27554047 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette275540471759827344 27554048 imagette275540481759827346 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27552574 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27554038,27554039,27554040,27554041,27554042,27554043,27554044,27554045,27554046,27554047,27554048?tags=metal,autre,pet_clair,pehd,pet_fonce,environnement,carton,mal_croppe,flou,papier,background args[1387757578] : ((1387757578, -5.753941704179917, 492609224), (1387757578, -0.7931925397659149, 501862349), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757560] : ((1387757560, -7.026431374714511, 492609224), (1387757560, 0.08066490716653194, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757559] : ((1387757559, -7.200972776036583, 492609224), (1387757559, 0.05156358619085376, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757556] : ((1387757556, -7.1606201410573025, 492609224), (1387757556, 0.07884123984300424, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757552] : ((1387757552, -6.890552245276118, 492609224), (1387757552, 0.12206546029374259, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757549] : ((1387757549, -7.014914703557785, 492609224), (1387757549, 0.21995126977736598, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757546] : ((1387757546, -6.956636274616181, 492609224), (1387757546, 0.01881136171412502, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757532] : ((1387757532, -7.022769418611264, 492609224), (1387757532, 0.17138369976574447, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757530] : ((1387757530, -7.253702374078645, 492609224), (1387757530, 0.12393296796377647, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757527] : ((1387757527, -7.100145298016664, 492609224), (1387757527, 0.18945409077057426, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757523] : ((1387757523, -7.0264154573293505, 492609224), (1387757523, 0.19406820329727226, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757518] : ((1387757518, -7.007675119126221, 492609224), (1387757518, -0.020271585305929193, 2107752395), '0.04469538298314339') We are sending mail with results at report@fotonower.com args[1387757514] : ((1387757514, -6.2404604710870055, 492609224), (1387757514, -0.2908976590612717, 496442774), '0.04469538298314339') We are sending mail with results at report@fotonower.com refus_total : 0.04469538298314339 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27552574 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27552574_07-10-2025_10_55_40.pdf results_Auto_P27552574_07-10-2025_10_55_40.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27552574_07-10-2025_10_55_40.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27552574','results_Auto_P27552574_07-10-2025_10_55_40.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27552574_07-10-2025_10_55_40.pdf','pdf','','0.9','0.04469538298314339') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27552574

https://www.fotonower.com/image?json=false&list_photos_id=1387757578
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757560
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757559
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757556
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757552
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757549
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757546
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757532
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757530
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757527
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757523
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757518
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387757514
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.47%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/27554038?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27554039?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27554040?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27554044?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27554047?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27552574_07-10-2025_10_55_40.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27554038,27554039,27554040,27554041,27554042,27554043,27554044,27554045,27554046,27554047,27554048?tags=metal,autre,pet_clair,pehd,pet_fonce,environnement,carton,mal_croppe,flou,papier,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 07 Oct 2025 08:55:51 GMT Content-Length: 0 Connection: close X-Message-Id: 1sdwx4_gTYyuiEtSRB1HCA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1387757578, 1387757560, 1387757559, 1387757556, 1387757552, 1387757549, 1387757546, 1387757532, 1387757530, 1387757527, 1387757523, 1387757518, 1387757514] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757578', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757560', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757559', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757556', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757552', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757549', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757546', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757532', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757530', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757527', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757523', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757518', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757514', None, None, None, None, None, '3866639') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.0367579460144043 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.077618837356567 time spend to save output : 0.037030935287475586 total time spend for step 9 : 11.114649772644043 step10:split_time_score Tue Oct 7 10:55:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06102025 27552574 Nombre de photos uploadées : 13 / 23040 (0%) 06102025 27552574 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 06102025 27552574 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006535053253173828 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.7983038425445557 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27552560 order by id desc limit 1 Qualite : 0.04469538298314339 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27552574_07-10-2025_10_55_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27552574 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27552574 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27552588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27552590 order by id desc limit 1 Qualite : 0.08551748167438271 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27552604_07-10-2025_10_16_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27552604 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27552604 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06102025': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1387757578, 1387757560, 1387757559, 1387757556, 1387757552, 1387757549, 1387757546, 1387757532, 1387757530, 1387757527, 1387757523, 1387757518, 1387757514] Looping around the photos to save general results len do output : 1 /27552574Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757578', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757560', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757559', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757556', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757552', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757549', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757546', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757532', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757530', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757527', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757523', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757518', None, None, None, None, None, '3866639') ('3318', None, None, None, None, None, None, None, '3866639') ('3318', '27552574', '1387757514', None, None, None, None, None, '3866639') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.1260221004486084 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.7083888053894043 time spend to save output : 0.12626361846923828 total time spend for step 10 : 3.8346524238586426 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 132.19user 134.04system 5:29.04elapsed 80%CPU (0avgtext+0avgdata 4978788maxresident)k 2506192inputs+127072outputs (24404major+12710706minor)pagefaults 0swaps