python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1951098 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4128350'] with mtr_portfolio_ids : ['28957702'] and first list_photo_ids : [] new path : /proc/1951098/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.298955202102661 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Nov 27 09:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-27 09:40:34.709519: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-27 09:40:34.738514: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-27 09:40:34.740624: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa1e4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-27 09:40:34.740675: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-27 09:40:34.744182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-27 09:40:35.029366: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x23bb6450 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-27 09:40:35.029414: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-27 09:40:35.030791: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-27 09:40:35.034601: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-27 09:40:35.038320: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-27 09:40:35.040923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-27 09:40:35.041792: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-27 09:40:35.044818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-27 09:40:35.046124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-27 09:40:35.051600: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-27 09:40:35.053069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-27 09:40:35.053124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-27 09:40:35.053885: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-27 09:40:35.053900: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-27 09:40:35.053909: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-27 09:40:35.055591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-27 09:40:35.318880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-27 09:40:35.318973: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-27 09:40:35.319000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-27 09:40:35.319026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-27 09:40:35.319050: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-27 09:40:35.319074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-27 09:40:35.319097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-27 09:40:35.319121: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-27 09:40:35.320537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-27 09:40:35.321665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-27 09:40:35.321691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-27 09:40:35.321705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-27 09:40:35.321717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-27 09:40:35.321730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-27 09:40:35.321743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-27 09:40:35.321756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-27 09:40:35.321769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-27 09:40:35.323033: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-27 09:40:35.323061: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-27 09:40:35.323069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-27 09:40:35.323077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-27 09:40:35.324432: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-27 09:40:44.310158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-27 09:40:44.512813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 Detection mask done ! Trying to reset tf kernel 1951597 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [372, 216, 666, 756] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002663135528564453 nb_pixel_total : 117636 time to create 1 rle with old method : 0.12143492698669434 length of segment : 334 DEBUG bbox = [174, 318, 420, 498] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043010711669921875 nb_pixel_total : 25815 time to create 1 rle with old method : 0.027298688888549805 length of segment : 226 DEBUG bbox = [2082, 2136, 2154, 2406] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00019359588623046875 nb_pixel_total : 11649 time to create 1 rle with old method : 0.01285696029663086 length of segment : 70 DEBUG bbox = [1692, 1170, 1818, 1386] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002636909484863281 nb_pixel_total : 17185 time to create 1 rle with old method : 0.018589258193969727 length of segment : 137 DEBUG bbox = [636, 2598, 780, 2820] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003056526184082031 nb_pixel_total : 21977 time to create 1 rle with old method : 0.023538589477539062 length of segment : 131 DEBUG bbox = [1218, 534, 2088, 1734] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.6970319747924805 nb_pixel_total : 576951 time to create 1 rle with new method : 0.03897213935852051 length of segment : 1163 DEBUG bbox = [1494, 2358, 1878, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007174015045166016 nb_pixel_total : 38184 time to create 1 rle with old method : 0.03979945182800293 length of segment : 403 DEBUG bbox = [174, 2034, 498, 2496] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011987686157226562 nb_pixel_total : 57608 time to create 1 rle with old method : 0.06627368927001953 length of segment : 420 DEBUG bbox = [1056, 2928, 1182, 3042] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00020170211791992188 nb_pixel_total : 7284 time to create 1 rle with old method : 0.008063077926635742 length of segment : 123 DEBUG bbox = [600, 1506, 834, 1788] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006344318389892578 nb_pixel_total : 33322 time to create 1 rle with old method : 0.03563857078552246 length of segment : 233 DEBUG bbox = [2064, 2082, 2154, 2388] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00029730796813964844 nb_pixel_total : 16901 time to create 1 rle with old method : 0.018970489501953125 length of segment : 76 DEBUG bbox = [240, 690, 408, 906] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 18915 time to create 1 rle with old method : 0.020874977111816406 length of segment : 150 DEBUG bbox = [1110, 2772, 1248, 2970] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003044605255126953 nb_pixel_total : 16326 time to create 1 rle with old method : 0.022992372512817383 length of segment : 113 DEBUG bbox = [582, 2862, 1068, 3114] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022766590118408203 nb_pixel_total : 64671 time to create 1 rle with old method : 0.0677194595336914 length of segment : 411 DEBUG bbox = [264, 852, 990, 1584] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004433870315551758 nb_pixel_total : 248998 time to create 1 rle with new method : 0.024723529815673828 length of segment : 647 DEBUG bbox = [222, 12, 876, 318] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004250764846801758 nb_pixel_total : 140368 time to create 1 rle with old method : 0.15441083908081055 length of segment : 679 DEBUG bbox = [6, 2286, 144, 2424] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005211830139160156 nb_pixel_total : 13137 time to create 1 rle with old method : 0.015015840530395508 length of segment : 133 DEBUG bbox = [108, 534, 756, 888] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003351926803588867 nb_pixel_total : 85919 time to create 1 rle with old method : 0.09349346160888672 length of segment : 567 DEBUG bbox = [606, 1836, 930, 2280] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023903846740722656 nb_pixel_total : 92561 time to create 1 rle with old method : 0.10137701034545898 length of segment : 289 DEBUG bbox = [960, 1998, 1134, 2112] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046825408935546875 nb_pixel_total : 13369 time to create 1 rle with old method : 0.014078140258789062 length of segment : 151 DEBUG bbox = [576, 324, 918, 498] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007393360137939453 nb_pixel_total : 37988 time to create 1 rle with old method : 0.04201388359069824 length of segment : 321 DEBUG bbox = [240, 882, 474, 1260] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010614395141601562 nb_pixel_total : 42889 time to create 1 rle with old method : 0.044097900390625 length of segment : 299 DEBUG bbox = [978, 2424, 1098, 2568] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036144256591796875 nb_pixel_total : 10852 time to create 1 rle with old method : 0.011701107025146484 length of segment : 114 DEBUG bbox = [390, 1524, 846, 1836] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020923614501953125 nb_pixel_total : 86618 time to create 1 rle with old method : 0.09142112731933594 length of segment : 459 DEBUG bbox = [576, 1680, 906, 1902] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007596015930175781 nb_pixel_total : 43218 time to create 1 rle with old method : 0.0484621524810791 length of segment : 284 DEBUG bbox = [402, 354, 534, 582] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00033473968505859375 nb_pixel_total : 17224 time to create 1 rle with old method : 0.019907236099243164 length of segment : 118 DEBUG bbox = [186, 2502, 384, 2652] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005571842193603516 nb_pixel_total : 16086 time to create 1 rle with old method : 0.020132780075073242 length of segment : 161 DEBUG bbox = [222, 2298, 564, 2508] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001058816909790039 nb_pixel_total : 46240 time to create 1 rle with old method : 0.05326104164123535 length of segment : 299 DEBUG bbox = [1650, 1038, 1962, 1326] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001764535903930664 nb_pixel_total : 73735 time to create 1 rle with old method : 0.08407306671142578 length of segment : 309 DEBUG bbox = [132, 1938, 390, 2256] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001125335693359375 nb_pixel_total : 41727 time to create 1 rle with old method : 0.0463864803314209 length of segment : 192 DEBUG bbox = [1614, 1512, 1764, 1638] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004200935363769531 nb_pixel_total : 11749 time to create 1 rle with old method : 0.013385772705078125 length of segment : 128 DEBUG bbox = [168, 1002, 456, 1230] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000942230224609375 nb_pixel_total : 29625 time to create 1 rle with old method : 0.03328371047973633 length of segment : 230 DEBUG bbox = [12, 60, 306, 540] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018956661224365234 nb_pixel_total : 86406 time to create 1 rle with old method : 0.09381818771362305 length of segment : 312 DEBUG bbox = [210, 2262, 366, 2400] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005006790161132812 nb_pixel_total : 13450 time to create 1 rle with old method : 0.017503976821899414 length of segment : 132 DEBUG bbox = [774, 1506, 1062, 1644] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007977485656738281 nb_pixel_total : 21806 time to create 1 rle with old method : 0.02465081214904785 length of segment : 263 DEBUG bbox = [60, 582, 462, 1128] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004995584487915039 nb_pixel_total : 130675 time to create 1 rle with old method : 0.16862702369689941 length of segment : 462 DEBUG bbox = [1944, 2184, 2040, 2436] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004127025604248047 nb_pixel_total : 15289 time to create 1 rle with old method : 0.019612789154052734 length of segment : 92 DEBUG bbox = [2064, 474, 2154, 624] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002884864807128906 nb_pixel_total : 10271 time to create 1 rle with old method : 0.01178741455078125 length of segment : 90 DEBUG bbox = [1614, 2076, 1740, 2190] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031447410583496094 nb_pixel_total : 9784 time to create 1 rle with old method : 0.011124849319458008 length of segment : 137 DEBUG bbox = [72, 2478, 198, 2610] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036454200744628906 nb_pixel_total : 10949 time to create 1 rle with old method : 0.012296199798583984 length of segment : 119 DEBUG bbox = [636, 1296, 984, 1560] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016453266143798828 nb_pixel_total : 58823 time to create 1 rle with old method : 0.06586337089538574 length of segment : 312 DEBUG bbox = [1518, 726, 2160, 1368] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00829005241394043 nb_pixel_total : 290468 time to create 1 rle with new method : 0.015689849853515625 length of segment : 581 DEBUG bbox = [972, 1128, 1422, 1656] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034339427947998047 nb_pixel_total : 111105 time to create 1 rle with old method : 0.11791825294494629 length of segment : 406 DEBUG bbox = [402, 864, 588, 984] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 14372 time to create 1 rle with old method : 0.01628255844116211 length of segment : 179 DEBUG bbox = [150, 2100, 264, 2304] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00047206878662109375 nb_pixel_total : 17472 time to create 1 rle with old method : 0.020044326782226562 length of segment : 106 DEBUG bbox = [180, 1764, 300, 1902] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000453948974609375 nb_pixel_total : 8986 time to create 1 rle with old method : 0.010283470153808594 length of segment : 97 DEBUG bbox = [150, 1188, 528, 1530] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002043008804321289 nb_pixel_total : 69108 time to create 1 rle with old method : 0.08264327049255371 length of segment : 282 DEBUG bbox = [204, 2244, 462, 2622] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017223358154296875 nb_pixel_total : 48621 time to create 1 rle with old method : 0.05500054359436035 length of segment : 266 DEBUG bbox = [690, 1734, 1056, 2220] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00287628173828125 nb_pixel_total : 107358 time to create 1 rle with old method : 0.11684989929199219 length of segment : 361 DEBUG bbox = [0, 414, 186, 720] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008065700531005859 nb_pixel_total : 34107 time to create 1 rle with old method : 0.035945892333984375 length of segment : 169 DEBUG bbox = [384, 2532, 762, 3036] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036067962646484375 nb_pixel_total : 113578 time to create 1 rle with old method : 0.12138009071350098 length of segment : 495 DEBUG bbox = [300, 768, 540, 1074] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00122833251953125 nb_pixel_total : 41512 time to create 1 rle with old method : 0.04318404197692871 length of segment : 303 DEBUG bbox = [2052, 1812, 2154, 1920] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031065940856933594 nb_pixel_total : 6884 time to create 1 rle with old method : 0.007863998413085938 length of segment : 92 DEBUG bbox = [858, 2694, 1308, 3024] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002574920654296875 nb_pixel_total : 109719 time to create 1 rle with old method : 0.12355160713195801 length of segment : 445 DEBUG bbox = [1092, 1536, 1578, 2028] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003968000411987305 nb_pixel_total : 154891 time to create 1 rle with new method : 0.006717681884765625 length of segment : 468 DEBUG bbox = [1764, 2568, 2124, 3066] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020949840545654297 nb_pixel_total : 100481 time to create 1 rle with old method : 0.1123359203338623 length of segment : 353 DEBUG bbox = [408, 2148, 588, 2424] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005857944488525391 nb_pixel_total : 15966 time to create 1 rle with old method : 0.018883466720581055 length of segment : 150 DEBUG bbox = [96, 2358, 300, 2538] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000492095947265625 nb_pixel_total : 14280 time to create 1 rle with old method : 0.016480684280395508 length of segment : 164 DEBUG bbox = [18, 270, 174, 444] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 18649 time to create 1 rle with old method : 0.02222609519958496 length of segment : 146 DEBUG bbox = [12, 1218, 90, 1416] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003097057342529297 nb_pixel_total : 10191 time to create 1 rle with old method : 0.012336492538452148 length of segment : 69 DEBUG bbox = [1044, 1974, 1320, 2190] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009419918060302734 nb_pixel_total : 35775 time to create 1 rle with old method : 0.040891408920288086 length of segment : 262 DEBUG bbox = [1134, 2046, 1362, 2274] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010793209075927734 nb_pixel_total : 27592 time to create 1 rle with old method : 0.03222918510437012 length of segment : 218 DEBUG bbox = [1962, 2280, 2160, 2700] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014541149139404297 nb_pixel_total : 33960 time to create 1 rle with old method : 0.04405713081359863 length of segment : 207 DEBUG bbox = [1680, 2718, 1878, 2898] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008373260498046875 nb_pixel_total : 18229 time to create 1 rle with old method : 0.021296024322509766 length of segment : 177 DEBUG bbox = [1524, 2418, 1674, 2568] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006747245788574219 nb_pixel_total : 14578 time to create 1 rle with old method : 0.01827073097229004 length of segment : 129 DEBUG bbox = [2028, 1908, 2148, 2034] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041604042053222656 nb_pixel_total : 9758 time to create 1 rle with old method : 0.013599157333374023 length of segment : 142 DEBUG bbox = [1554, 930, 1668, 1044] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00039696693420410156 nb_pixel_total : 8585 time to create 1 rle with old method : 0.010179996490478516 length of segment : 109 DEBUG bbox = [24, 696, 114, 846] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 7777 time to create 1 rle with old method : 0.009160518646240234 length of segment : 75 DEBUG bbox = [42, 2682, 348, 2910] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001424551010131836 nb_pixel_total : 55458 time to create 1 rle with old method : 0.06085348129272461 length of segment : 368 DEBUG bbox = [102, 1458, 450, 1842] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002164125442504883 nb_pixel_total : 28963 time to create 1 rle with old method : 0.03290891647338867 length of segment : 260 DEBUG bbox = [936, 1272, 1386, 1848] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003970146179199219 nb_pixel_total : 100643 time to create 1 rle with old method : 0.11292600631713867 length of segment : 443 DEBUG bbox = [1146, 882, 1458, 1416] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023293495178222656 nb_pixel_total : 89058 time to create 1 rle with old method : 0.09919428825378418 length of segment : 309 DEBUG bbox = [108, 1296, 462, 1686] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019664764404296875 nb_pixel_total : 73514 time to create 1 rle with old method : 0.0827951431274414 length of segment : 410 DEBUG bbox = [36, 1194, 288, 1548] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010306835174560547 nb_pixel_total : 58757 time to create 1 rle with old method : 0.0633089542388916 length of segment : 267 DEBUG bbox = [426, 2970, 630, 3114] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006213188171386719 nb_pixel_total : 16709 time to create 1 rle with old method : 0.01851654052734375 length of segment : 191 DEBUG bbox = [996, 2760, 1200, 2970] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007598400115966797 nb_pixel_total : 28611 time to create 1 rle with old method : 0.03342103958129883 length of segment : 186 DEBUG bbox = [648, 1152, 954, 1614] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018768310546875 nb_pixel_total : 77231 time to create 1 rle with old method : 0.08495807647705078 length of segment : 280 DEBUG bbox = [18, 2388, 234, 2754] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011708736419677734 nb_pixel_total : 54316 time to create 1 rle with old method : 0.060024261474609375 length of segment : 217 DEBUG bbox = [276, 2154, 438, 2346] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006232261657714844 nb_pixel_total : 22826 time to create 1 rle with old method : 0.025919198989868164 length of segment : 145 DEBUG bbox = [660, 1842, 1266, 2382] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005112409591674805 nb_pixel_total : 201847 time to create 1 rle with new method : 0.007797956466674805 length of segment : 538 DEBUG bbox = [24, 1218, 354, 1692] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001974344253540039 nb_pixel_total : 85278 time to create 1 rle with old method : 0.09257149696350098 length of segment : 323 DEBUG bbox = [72, 1104, 264, 1290] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003972053527832031 nb_pixel_total : 12362 time to create 1 rle with old method : 0.014141082763671875 length of segment : 189 DEBUG bbox = [12, 918, 126, 1068] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00028777122497558594 nb_pixel_total : 11976 time to create 1 rle with old method : 0.013882637023925781 length of segment : 104 DEBUG bbox = [300, 1860, 588, 2160] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001413583755493164 nb_pixel_total : 53933 time to create 1 rle with old method : 0.06224322319030762 length of segment : 266 DEBUG bbox = [258, 1056, 696, 2022] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003945350646972656 nb_pixel_total : 156680 time to create 1 rle with new method : 0.008092403411865234 length of segment : 405 DEBUG bbox = [678, 1374, 1176, 1884] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031900405883789062 nb_pixel_total : 182648 time to create 1 rle with new method : 0.0057086944580078125 length of segment : 490 time spent for convertir_results : 8.44944167137146 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 86 chid ids of type : 3594 Number RLEs to save : 23131 save missing photos in datou_result : time spend for datou_step_exec : 55.8310182094574 time spend to save output : 1.5584447383880615 total time spend for step 1 : 57.38946294784546 step2:crop_condition Thu Nov 27 09:41:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 86 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764232899_1951098 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235012_0.png', 0, 518, 294, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235014_0.png', 0, 259, 66, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235015_0.png', 0, 215, 105, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235017_0.png', 0, 1181, 834, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235018_0.png', 0, 155, 376, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235019_0.png', 0, 455, 299, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235021_0.png', 0, 270, 220, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235022_0.png', 0, 282, 74, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235029_0.png', 0, 293, 567, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235031_0.png', 0, 105, 149, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235033_0.png', 0, 350, 213, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235039_0.png', 0, 207, 291, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235046_0.png', 0, 136, 263, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235048_0.png', 0, 234, 92, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235054_0.png', 0, 512, 403, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235055_0.png', 0, 118, 179, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235060_0.png', 0, 460, 361, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235064_0.png', 0, 95, 91, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235073_0.png', 0, 203, 218, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235074_0.png', 0, 401, 177, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235077_0.png', 0, 116, 118, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235082_0.png', 0, 543, 420, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235083_0.png', 0, 509, 273, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235088_0.png', 0, 414, 280, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235090_0.png', 0, 174, 145, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232904), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235091_0.png', 0, 534, 538, 0, 1764232904,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.093053817749023 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764232909_1951098 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235013_0.png', 0, 155, 226, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235023_0.png', 0, 183, 147, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235026_0.png', 0, 690, 647, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235037_0.png', 0, 210, 116, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235038_0.png', 0, 142, 161, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235052_0.png', 0, 230, 309, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235063_0.png', 0, 302, 218, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235068_0.png', 0, 253, 145, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235069_0.png', 0, 166, 164, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235081_0.png', 0, 307, 205, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232911), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235086_0.png', 0, 125, 188, 0, 1764232911,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.7951819896698 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764232914_1951098 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235016_0.png', 0, 207, 131, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235020_0.png', 0, 93, 123, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235024_0.png', 0, 188, 110, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235032_0.png', 0, 163, 316, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235042_0.png', 0, 118, 126, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235045_0.png', 0, 135, 132, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235049_0.png', 0, 140, 89, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235050_0.png', 0, 113, 114, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235051_0.png', 0, 120, 119, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235057_0.png', 0, 122, 96, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232916), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235075_0.png', 0, 137, 177, 0, 1764232916,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.502723455429077 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3736932 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764232928_1951098 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235025_0.png', 0, 234, 406, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235027_0.png', 0, 290, 645, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235028_0.png', 0, 119, 133, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235030_0.png', 0, 426, 286, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235035_0.png', 0, 269, 440, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235036_0.png', 0, 197, 283, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235041_0.png', 0, 300, 178, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235043_0.png', 0, 191, 230, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235044_0.png', 0, 451, 254, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235047_0.png', 0, 535, 355, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235053_0.png', 0, 606, 579, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235058_0.png', 0, 323, 282, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235059_0.png', 0, 307, 241, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235061_0.png', 0, 289, 169, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235062_0.png', 0, 495, 325, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235065_0.png', 0, 305, 434, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235066_0.png', 0, 457, 468, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235067_0.png', 0, 409, 353, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235070_0.png', 0, 171, 146, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235071_0.png', 0, 193, 68, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235072_0.png', 0, 176, 259, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235079_0.png', 0, 131, 71, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235080_0.png', 0, 211, 304, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235084_0.png', 0, 370, 309, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235085_0.png', 0, 350, 230, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235089_0.png', 0, 363, 209, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235092_0.png', 0, 433, 319, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235093_0.png', 0, 132, 167, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235094_0.png', 0, 144, 104, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235095_0.png', 0, 292, 266, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235096_0.png', 0, 722, 364, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232936), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235097_0.png', 0, 504, 478, 0, 1764232936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 32 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.37843108177185 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764232940_1951098 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232941), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235034_0.png', 0, 129, 114, 0, 1764232941,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232941), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235040_0.png', 0, 285, 309, 0, 1764232941,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232941), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235056_0.png', 0, 203, 105, 0, 1764232941,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232941), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235076_0.png', 0, 146, 129, 0, 1764232941,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232941), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235078_0.png', 0, 105, 99, 0, 1764232941,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764232941), 0.0, 0.0, 14, '', 0, 0, '1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235087_0.png', 0, 210, 186, 0, 1764232941,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2152652740478516 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1396378658, 1396378655, 1396378651, 1396378645, 1396378631, 1396378617, 1396378581, 1396378546, 1396378505, 1396378468, 1396378432] Looping around the photos to save general results len do output : 86 /1396385878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396385974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378658', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378655', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378651', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378645', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378631', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378617', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378581', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378546', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378505', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378468', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378432', None, None, None, None, None, '4128350') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 269 time used for this insertion : 0.04876565933227539 save_final save missing photos in datou_result : time spend for datou_step_exec : 52.99556064605713 time spend to save output : 0.05255722999572754 total time spend for step 2 : 53.048117876052856 step3:rle_unique_nms_with_priority Thu Nov 27 09:42:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 86 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.172304630279541 time for calcul the mask position with numpy : 0.6943211555480957 nb_pixel_total : 7540372 time to create 1 rle with new method : 0.7224056720733643 time for calcul the mask position with numpy : 0.028306007385253906 nb_pixel_total : 559766 time to create 1 rle with new method : 1.5990819931030273 time for calcul the mask position with numpy : 0.02942514419555664 nb_pixel_total : 21977 time to create 1 rle with old method : 0.03543972969055176 time for calcul the mask position with numpy : 0.027740478515625 nb_pixel_total : 17185 time to create 1 rle with old method : 0.019501447677612305 time for calcul the mask position with numpy : 0.02568793296813965 nb_pixel_total : 11649 time to create 1 rle with old method : 0.013240337371826172 time for calcul the mask position with numpy : 0.025478839874267578 nb_pixel_total : 25815 time to create 1 rle with old method : 0.028756141662597656 time for calcul the mask position with numpy : 0.025994539260864258 nb_pixel_total : 117636 time to create 1 rle with old method : 0.12954998016357422 create new chi : 3.4760544300079346 time to delete rle : 0.02639007568359375 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 6282 TO DO : save crop sub photo not yet done ! save time : 0.45187973976135254 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.250185012817383 time for calcul the mask position with numpy : 0.5480499267578125 nb_pixel_total : 8041197 time to create 1 rle with new method : 0.8157970905303955 time for calcul the mask position with numpy : 0.02737903594970703 nb_pixel_total : 64671 time to create 1 rle with old method : 0.0880274772644043 time for calcul the mask position with numpy : 0.027157306671142578 nb_pixel_total : 16318 time to create 1 rle with old method : 0.018261194229125977 time for calcul the mask position with numpy : 0.02468562126159668 nb_pixel_total : 18915 time to create 1 rle with old method : 0.020987272262573242 time for calcul the mask position with numpy : 0.024789810180664062 nb_pixel_total : 16901 time to create 1 rle with old method : 0.01899242401123047 time for calcul the mask position with numpy : 0.025958538055419922 nb_pixel_total : 33322 time to create 1 rle with old method : 0.03710150718688965 time for calcul the mask position with numpy : 0.02616596221923828 nb_pixel_total : 7284 time to create 1 rle with old method : 0.008154630661010742 time for calcul the mask position with numpy : 0.026175260543823242 nb_pixel_total : 57608 time to create 1 rle with old method : 0.06475949287414551 time for calcul the mask position with numpy : 0.02548503875732422 nb_pixel_total : 38184 time to create 1 rle with old method : 0.04302835464477539 create new chi : 1.9149518013000488 time to delete rle : 0.0009236335754394531 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 6012 TO DO : save crop sub photo not yet done ! save time : 0.44236326217651367 nb_obj : 12 nb_hashtags : 5 time to prepare the origin masks : 4.917280673980713 time for calcul the mask position with numpy : 0.5024528503417969 nb_pixel_total : 7481267 time to create 1 rle with new method : 0.7521004676818848 time for calcul the mask position with numpy : 0.024804353713989258 nb_pixel_total : 17144 time to create 1 rle with old method : 0.0187532901763916 time for calcul the mask position with numpy : 0.024971961975097656 nb_pixel_total : 23290 time to create 1 rle with old method : 0.02590465545654297 time for calcul the mask position with numpy : 0.02638840675354004 nb_pixel_total : 86618 time to create 1 rle with old method : 0.09410643577575684 time for calcul the mask position with numpy : 0.024911880493164062 nb_pixel_total : 10852 time to create 1 rle with old method : 0.011655569076538086 time for calcul the mask position with numpy : 0.023516416549682617 nb_pixel_total : 42889 time to create 1 rle with old method : 0.045636892318725586 time for calcul the mask position with numpy : 0.02525615692138672 nb_pixel_total : 37988 time to create 1 rle with old method : 0.04104876518249512 time for calcul the mask position with numpy : 0.024769306182861328 nb_pixel_total : 13369 time to create 1 rle with old method : 0.014283895492553711 time for calcul the mask position with numpy : 0.02380204200744629 nb_pixel_total : 92561 time to create 1 rle with old method : 0.10544443130493164 time for calcul the mask position with numpy : 0.028159379959106445 nb_pixel_total : 85919 time to create 1 rle with old method : 0.09756135940551758 time for calcul the mask position with numpy : 0.024283885955810547 nb_pixel_total : 13137 time to create 1 rle with old method : 0.013381481170654297 time for calcul the mask position with numpy : 0.024995088577270508 nb_pixel_total : 140368 time to create 1 rle with old method : 0.1745765209197998 time for calcul the mask position with numpy : 0.026442766189575195 nb_pixel_total : 248998 time to create 1 rle with new method : 0.7084770202636719 create new chi : 2.9740405082702637 time to delete rle : 0.0013065338134765625 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 9884 TO DO : save crop sub photo not yet done ! save time : 0.6740424633026123 nb_obj : 6 nb_hashtags : 5 time to prepare the origin masks : 2.80763578414917 time for calcul the mask position with numpy : 0.6132993698120117 nb_pixel_total : 8075238 time to create 1 rle with new method : 0.9157040119171143 time for calcul the mask position with numpy : 0.024878740310668945 nb_pixel_total : 29625 time to create 1 rle with old method : 0.033231496810913086 time for calcul the mask position with numpy : 0.02552652359008789 nb_pixel_total : 11749 time to create 1 rle with old method : 0.013232946395874023 time for calcul the mask position with numpy : 0.027161359786987305 nb_pixel_total : 41727 time to create 1 rle with old method : 0.04694652557373047 time for calcul the mask position with numpy : 0.025974512100219727 nb_pixel_total : 73735 time to create 1 rle with old method : 0.08173561096191406 time for calcul the mask position with numpy : 0.02471923828125 nb_pixel_total : 46240 time to create 1 rle with old method : 0.05165529251098633 time for calcul the mask position with numpy : 0.02544236183166504 nb_pixel_total : 16086 time to create 1 rle with old method : 0.017527341842651367 create new chi : 1.9718787670135498 time to delete rle : 0.0006432533264160156 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4798 TO DO : save crop sub photo not yet done ! save time : 0.346193790435791 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 2.682053327560425 time for calcul the mask position with numpy : 0.5184705257415771 nb_pixel_total : 7995770 time to create 1 rle with new method : 0.7985172271728516 time for calcul the mask position with numpy : 0.022706031799316406 nb_pixel_total : 10949 time to create 1 rle with old method : 0.011270999908447266 time for calcul the mask position with numpy : 0.022197961807250977 nb_pixel_total : 9784 time to create 1 rle with old method : 0.010464906692504883 time for calcul the mask position with numpy : 0.022994041442871094 nb_pixel_total : 10271 time to create 1 rle with old method : 0.010585784912109375 time for calcul the mask position with numpy : 0.02369093894958496 nb_pixel_total : 15289 time to create 1 rle with old method : 0.016176462173461914 time for calcul the mask position with numpy : 0.024540185928344727 nb_pixel_total : 130675 time to create 1 rle with old method : 0.13578009605407715 time for calcul the mask position with numpy : 0.023261070251464844 nb_pixel_total : 21806 time to create 1 rle with old method : 0.022594213485717773 time for calcul the mask position with numpy : 0.02327895164489746 nb_pixel_total : 13450 time to create 1 rle with old method : 0.013865232467651367 time for calcul the mask position with numpy : 0.023983478546142578 nb_pixel_total : 86406 time to create 1 rle with old method : 0.08896398544311523 create new chi : 1.8527295589447021 time to delete rle : 0.0007188320159912109 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 5374 TO DO : save crop sub photo not yet done ! save time : 0.38757777214050293 nb_obj : 8 nb_hashtags : 5 time to prepare the origin masks : 2.830483913421631 time for calcul the mask position with numpy : 0.5140280723571777 nb_pixel_total : 7675445 time to create 1 rle with new method : 0.82651686668396 time for calcul the mask position with numpy : 0.023705244064331055 nb_pixel_total : 48621 time to create 1 rle with old method : 0.05231356620788574 time for calcul the mask position with numpy : 0.0274202823638916 nb_pixel_total : 69108 time to create 1 rle with old method : 0.07503962516784668 time for calcul the mask position with numpy : 0.03038311004638672 nb_pixel_total : 8986 time to create 1 rle with old method : 0.00971364974975586 time for calcul the mask position with numpy : 0.023204565048217773 nb_pixel_total : 17472 time to create 1 rle with old method : 0.018411636352539062 time for calcul the mask position with numpy : 0.023304462432861328 nb_pixel_total : 14372 time to create 1 rle with old method : 0.01481318473815918 time for calcul the mask position with numpy : 0.02474188804626465 nb_pixel_total : 111105 time to create 1 rle with old method : 0.11686587333679199 time for calcul the mask position with numpy : 0.02575969696044922 nb_pixel_total : 290468 time to create 1 rle with new method : 0.5736618041992188 time for calcul the mask position with numpy : 0.024095535278320312 nb_pixel_total : 58823 time to create 1 rle with old method : 0.06296420097351074 create new chi : 2.5327484607696533 time to delete rle : 0.0010020732879638672 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6618 TO DO : save crop sub photo not yet done ! save time : 0.4656996726989746 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.4907538890838623 time for calcul the mask position with numpy : 0.6110000610351562 nb_pixel_total : 7726351 time to create 1 rle with new method : 0.8568007946014404 time for calcul the mask position with numpy : 0.02454233169555664 nb_pixel_total : 154891 time to create 1 rle with new method : 0.7126195430755615 time for calcul the mask position with numpy : 0.024233341217041016 nb_pixel_total : 109719 time to create 1 rle with old method : 0.11928343772888184 time for calcul the mask position with numpy : 0.029790878295898438 nb_pixel_total : 6884 time to create 1 rle with old method : 0.008252382278442383 time for calcul the mask position with numpy : 0.02544546127319336 nb_pixel_total : 41512 time to create 1 rle with old method : 0.043814897537231445 time for calcul the mask position with numpy : 0.025317907333374023 nb_pixel_total : 113578 time to create 1 rle with old method : 0.12002730369567871 time for calcul the mask position with numpy : 0.02530646324157715 nb_pixel_total : 34107 time to create 1 rle with old method : 0.03698873519897461 time for calcul the mask position with numpy : 0.025608062744140625 nb_pixel_total : 107358 time to create 1 rle with old method : 0.1150815486907959 create new chi : 2.8713455200195312 time to delete rle : 0.0010170936584472656 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 6826 TO DO : save crop sub photo not yet done ! save time : 0.4829897880554199 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 1.9145886898040771 time for calcul the mask position with numpy : 0.5348241329193115 nb_pixel_total : 8099058 time to create 1 rle with new method : 0.8374037742614746 time for calcul the mask position with numpy : 0.023503780364990234 nb_pixel_total : 35775 time to create 1 rle with old method : 0.03818774223327637 time for calcul the mask position with numpy : 0.02309131622314453 nb_pixel_total : 10191 time to create 1 rle with old method : 0.010623931884765625 time for calcul the mask position with numpy : 0.022914886474609375 nb_pixel_total : 18649 time to create 1 rle with old method : 0.019475460052490234 time for calcul the mask position with numpy : 0.02301025390625 nb_pixel_total : 14280 time to create 1 rle with old method : 0.015392541885375977 time for calcul the mask position with numpy : 0.024412155151367188 nb_pixel_total : 15966 time to create 1 rle with old method : 0.01772475242614746 time for calcul the mask position with numpy : 0.024233102798461914 nb_pixel_total : 100481 time to create 1 rle with old method : 0.10430431365966797 create new chi : 1.760119915008545 time to delete rle : 0.0005593299865722656 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4448 TO DO : save crop sub photo not yet done ! save time : 0.3585994243621826 nb_obj : 10 nb_hashtags : 5 time to prepare the origin masks : 3.854379653930664 time for calcul the mask position with numpy : 0.4851086139678955 nb_pixel_total : 7988857 time to create 1 rle with new method : 0.946054220199585 time for calcul the mask position with numpy : 0.03921365737915039 nb_pixel_total : 100643 time to create 1 rle with old method : 0.10525250434875488 time for calcul the mask position with numpy : 0.03271961212158203 nb_pixel_total : 28963 time to create 1 rle with old method : 0.030701160430908203 time for calcul the mask position with numpy : 0.02354145050048828 nb_pixel_total : 55458 time to create 1 rle with old method : 0.05782651901245117 time for calcul the mask position with numpy : 0.023333311080932617 nb_pixel_total : 7777 time to create 1 rle with old method : 0.008152008056640625 time for calcul the mask position with numpy : 0.024669885635375977 nb_pixel_total : 8585 time to create 1 rle with old method : 0.009322404861450195 time for calcul the mask position with numpy : 0.02374553680419922 nb_pixel_total : 9758 time to create 1 rle with old method : 0.010325431823730469 time for calcul the mask position with numpy : 0.02332305908203125 nb_pixel_total : 14578 time to create 1 rle with old method : 0.015828847885131836 time for calcul the mask position with numpy : 0.02407383918762207 nb_pixel_total : 18229 time to create 1 rle with old method : 0.019456148147583008 time for calcul the mask position with numpy : 0.0244443416595459 nb_pixel_total : 33960 time to create 1 rle with old method : 0.035675764083862305 time for calcul the mask position with numpy : 0.02341175079345703 nb_pixel_total : 27592 time to create 1 rle with old method : 0.028758525848388672 create new chi : 2.0572597980499268 time to delete rle : 0.0009853839874267578 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 6416 TO DO : save crop sub photo not yet done ! save time : 0.4535384178161621 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 2.9331560134887695 time for calcul the mask position with numpy : 0.5632538795471191 nb_pixel_total : 7874847 time to create 1 rle with new method : 0.953770637512207 time for calcul the mask position with numpy : 0.024712085723876953 nb_pixel_total : 22826 time to create 1 rle with old method : 0.025115251541137695 time for calcul the mask position with numpy : 0.024004220962524414 nb_pixel_total : 54316 time to create 1 rle with old method : 0.05900454521179199 time for calcul the mask position with numpy : 0.025667905807495117 nb_pixel_total : 77231 time to create 1 rle with old method : 0.08278656005859375 time for calcul the mask position with numpy : 0.024003267288208008 nb_pixel_total : 28611 time to create 1 rle with old method : 0.03123307228088379 time for calcul the mask position with numpy : 0.025000810623168945 nb_pixel_total : 16709 time to create 1 rle with old method : 0.018079280853271484 time for calcul the mask position with numpy : 0.024729013442993164 nb_pixel_total : 57288 time to create 1 rle with old method : 0.06113481521606445 time for calcul the mask position with numpy : 0.024616718292236328 nb_pixel_total : 73514 time to create 1 rle with old method : 0.0773003101348877 time for calcul the mask position with numpy : 0.025322675704956055 nb_pixel_total : 89058 time to create 1 rle with old method : 0.0951387882232666 create new chi : 2.206181526184082 time to delete rle : 0.0008752346038818359 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 6125 TO DO : save crop sub photo not yet done ! save time : 0.4439575672149658 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 2.4215519428253174 time for calcul the mask position with numpy : 0.5999329090118408 nb_pixel_total : 7589676 time to create 1 rle with new method : 0.957512617111206 time for calcul the mask position with numpy : 0.025777578353881836 nb_pixel_total : 182648 time to create 1 rle with new method : 0.3520545959472656 time for calcul the mask position with numpy : 0.025672435760498047 nb_pixel_total : 156680 time to create 1 rle with new method : 0.7350108623504639 time for calcul the mask position with numpy : 0.023006916046142578 nb_pixel_total : 53933 time to create 1 rle with old method : 0.05839729309082031 time for calcul the mask position with numpy : 0.025289535522460938 nb_pixel_total : 11976 time to create 1 rle with old method : 0.013156890869140625 time for calcul the mask position with numpy : 0.025465965270996094 nb_pixel_total : 12362 time to create 1 rle with old method : 0.013649463653564453 time for calcul the mask position with numpy : 0.02807140350341797 nb_pixel_total : 85278 time to create 1 rle with old method : 0.09153938293457031 time for calcul the mask position with numpy : 0.025916337966918945 nb_pixel_total : 201847 time to create 1 rle with new method : 0.4885084629058838 create new chi : 3.6171205043792725 time to delete rle : 0.001199960708618164 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++Number RLEs to save : 6790 TO DO : save crop sub photo not yet done ! save time : 0.469832181930542 map_output_result : {1396378658: (0.0, 'Should be the crop_list due to order', 0), 1396378655: (0.0, 'Should be the crop_list due to order', 0), 1396378651: (0.0, 'Should be the crop_list due to order', 0), 1396378645: (0.0, 'Should be the crop_list due to order', 0), 1396378631: (0.0, 'Should be the crop_list due to order', 0), 1396378617: (0.0, 'Should be the crop_list due to order', 0), 1396378581: (0.0, 'Should be the crop_list due to order', 0), 1396378546: (0.0, 'Should be the crop_list due to order', 0), 1396378505: (0.0, 'Should be the crop_list due to order', 0), 1396378468: (0.0, 'Should be the crop_list due to order', 0), 1396378432: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1396378658, 1396378655, 1396378651, 1396378645, 1396378631, 1396378617, 1396378581, 1396378546, 1396378505, 1396378468, 1396378432] Looping around the photos to save general results len do output : 11 /1396378658.Didn't retrieve data . /1396378655.Didn't retrieve data . /1396378651.Didn't retrieve data . /1396378645.Didn't retrieve data . /1396378631.Didn't retrieve data . /1396378617.Didn't retrieve data . /1396378581.Didn't retrieve data . /1396378546.Didn't retrieve data . /1396378505.Didn't retrieve data . /1396378468.Didn't retrieve data . /1396378432.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378658', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378655', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378651', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378645', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378631', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378617', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378581', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378546', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378505', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378468', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378432', None, None, None, None, None, '4128350') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01784062385559082 save_final save missing photos in datou_result : time spend for datou_step_exec : 66.87493014335632 time spend to save output : 0.018312692642211914 total time spend for step 3 : 66.89324283599854 step4:ventilate_hashtags_in_portfolio Thu Nov 27 09:43:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28957702 get user id for portfolio 28957702 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28957702 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','mal_croppe','flou','autre','metal','pehd','background','environnement','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28957702 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','mal_croppe','flou','autre','metal','pehd','background','environnement','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28957702 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','mal_croppe','flou','autre','metal','pehd','background','environnement','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28958030,28958031,28958032,28958033,28958034,28958035,28958036,28958037,28958038,28958039,28958040?tags=papier,carton,mal_croppe,flou,autre,metal,pehd,background,environnement,pet_clair,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1396378658, 1396378655, 1396378651, 1396378645, 1396378631, 1396378617, 1396378581, 1396378546, 1396378505, 1396378468, 1396378432] Looping around the photos to save general results len do output : 1 /28957702. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378658', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378655', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378651', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378645', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378631', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378617', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378581', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378546', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378505', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378468', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378432', None, None, None, None, None, '4128350') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.020922422409057617 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0451111793518066 time spend to save output : 0.021328210830688477 total time spend for step 4 : 2.066439390182495 step5:final Thu Nov 27 09:43:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1396378658: ('0.056449060921717184',), 1396378655: ('0.056449060921717184',), 1396378651: ('0.056449060921717184',), 1396378645: ('0.056449060921717184',), 1396378631: ('0.056449060921717184',), 1396378617: ('0.056449060921717184',), 1396378581: ('0.056449060921717184',), 1396378546: ('0.056449060921717184',), 1396378505: ('0.056449060921717184',), 1396378468: ('0.056449060921717184',), 1396378432: ('0.056449060921717184',)} new output for save of step final : {1396378658: ('0.056449060921717184',), 1396378655: ('0.056449060921717184',), 1396378651: ('0.056449060921717184',), 1396378645: ('0.056449060921717184',), 1396378631: ('0.056449060921717184',), 1396378617: ('0.056449060921717184',), 1396378581: ('0.056449060921717184',), 1396378546: ('0.056449060921717184',), 1396378505: ('0.056449060921717184',), 1396378468: ('0.056449060921717184',), 1396378432: ('0.056449060921717184',)} [1396378658, 1396378655, 1396378651, 1396378645, 1396378631, 1396378617, 1396378581, 1396378546, 1396378505, 1396378468, 1396378432] Looping around the photos to save general results len do output : 11 /1396378658.Didn't retrieve data . /1396378655.Didn't retrieve data . /1396378651.Didn't retrieve data . /1396378645.Didn't retrieve data . /1396378631.Didn't retrieve data . /1396378617.Didn't retrieve data . /1396378581.Didn't retrieve data . /1396378546.Didn't retrieve data . /1396378505.Didn't retrieve data . /1396378468.Didn't retrieve data . /1396378432.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378658', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378655', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378651', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378645', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378631', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378617', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378581', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378546', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378505', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378468', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378432', None, None, None, None, None, '4128350') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01853203773498535 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1600048542022705 time spend to save output : 0.019123315811157227 total time spend for step 5 : 0.17912817001342773 step6:blur_detection Thu Nov 27 09:43:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76.jpg resize: (2160, 3840) 1396378658 -4.297820206857421 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496.jpg resize: (2160, 3840) 1396378655 -6.360074385154958 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1.jpg resize: (2160, 3840) 1396378651 -6.303489435080449 treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718.jpg resize: (2160, 3840) 1396378645 -6.154775152984089 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae.jpg resize: (2160, 3840) 1396378631 -6.242075023693626 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b.jpg resize: (2160, 3840) 1396378617 -6.188439159339109 treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef.jpg resize: (2160, 3840) 1396378581 -6.133988361058775 treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800.jpg resize: (2160, 3840) 1396378546 -6.3605810866699555 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda.jpg resize: (2160, 3840) 1396378505 -6.373693434199459 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72.jpg resize: (2160, 3840) 1396378468 -6.2432907055642755 treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037.jpg resize: (2160, 3840) 1396378432 -6.234741757463007 treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235012_0.png resize: (294, 518) 1396385878 -2.982124940544537 treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235014_0.png resize: (66, 259) 1396385879 -4.160238973914103 treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235015_0.png resize: (105, 215) 1396385880 -4.911561970531772 treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235017_0.png resize: (834, 1181) 1396385881 -5.341226442392421 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235018_0.png resize: (376, 155) 1396385882 -4.769600615766591 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235019_0.png resize: (299, 455) 1396385883 -3.66659758017155 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235021_0.png resize: (220, 270) 1396385884 -4.151870359195683 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235022_0.png resize: (74, 282) 1396385886 -3.786532826345954 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235029_0.png resize: (567, 293) 1396385887 -3.78180381014028 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235031_0.png resize: (149, 105) 1396385888 -2.45860216532359 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235033_0.png resize: (213, 350) 1396385890 -3.722528660115234 treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235039_0.png resize: (291, 207) 1396385891 -4.1218042956061085 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235046_0.png resize: (263, 136) 1396385892 -4.809104634486114 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235048_0.png resize: (92, 234) 1396385893 -4.185473646493865 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235054_0.png resize: (403, 512) 1396385894 -3.8416505752291674 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235055_0.png resize: (179, 118) 1396385895 -3.5612912086624653 treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235060_0.png resize: (361, 460) 1396385896 -3.554362319443766 treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235064_0.png resize: (91, 95) 1396385897 -3.920146206190765 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235073_0.png resize: (218, 203) 1396385898 -3.4672840293403673 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235074_0.png resize: (177, 401) 1396385899 -3.982187910481385 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235077_0.png resize: (118, 116) 1396385900 -2.3939754449192363 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235082_0.png resize: (420, 543) 1396385901 -3.4589348912374467 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235083_0.png resize: (273, 509) 1396385902 -4.453876374490485 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235088_0.png resize: (280, 414) 1396385903 -2.877838055356173 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235090_0.png resize: (145, 174) 1396385904 -0.9006650263493731 treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235091_0.png resize: (538, 534) 1396385905 -4.361459299721083 treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235013_0.png resize: (226, 155) 1396385910 -4.29487219865265 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235023_0.png resize: (147, 183) 1396385911 -3.511507704752357 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235026_0.png resize: (647, 690) 1396385912 -4.264871288979834 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235037_0.png resize: (116, 210) 1396385913 -2.645466442954728 treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235038_0.png resize: (161, 142) 1396385914 -3.1966132579712196 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235052_0.png resize: (309, 230) 1396385915 -3.34779089002873 treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235063_0.png resize: (218, 302) 1396385916 -4.138248769789522 treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235068_0.png resize: (145, 253) 1396385917 -2.7716206817741167 treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235069_0.png resize: (164, 166) 1396385918 -2.7888354174931456 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235081_0.png resize: (205, 307) 1396385919 -3.5405008761848014 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235086_0.png resize: (188, 125) 1396385920 -2.4311598834906074 treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235016_0.png resize: (131, 207) 1396385922 -4.611153007167581 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235020_0.png resize: (123, 93) 1396385923 -5.276334046547176 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235024_0.png resize: (110, 188) 1396385924 -3.541653280298435 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235032_0.png resize: (316, 163) 1396385925 -5.372467379941647 treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235042_0.png resize: (126, 118) 1396385926 -4.61053488417464 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235045_0.png resize: (132, 135) 1396385927 -4.568650403473669 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235049_0.png resize: (89, 140) 1396385928 -4.659900766639515 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235050_0.png resize: (114, 113) 1396385929 -4.514510790180366 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235051_0.png resize: (119, 120) 1396385930 -3.9571079067335586 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235057_0.png resize: (96, 122) 1396385931 -3.33503045840312 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235075_0.png resize: (177, 137) 1396385932 -3.7861980401228035 treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235025_0.png resize: (406, 234) 1396385936 -4.189895814246768 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235027_0.png resize: (645, 290) 1396385937 -4.404273203272305 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235028_0.png resize: (133, 119) 1396385938 -4.515320068886225 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235030_0.png resize: (286, 426) 1396385939 -5.031186677699116 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235035_0.png resize: (440, 269) 1396385940 -5.005586118671133 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235036_0.png resize: (283, 197) 1396385941 -4.342945529409986 treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235041_0.png resize: (178, 300) 1396385942 -3.745351603713095 treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235043_0.png resize: (230, 191) 1396385943 -3.3021097847857277 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235044_0.png resize: (254, 451) 1396385944 -5.311422829946333 treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235047_0.png resize: (355, 535) 1396385945 -5.331814874434655 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235053_0.png resize: (579, 606) 1396385946 -5.098429991977688 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235058_0.png resize: (282, 323) 1396385947 -5.058114739179805 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235059_0.png resize: (241, 307) 1396385948 -4.125966637694315 treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235061_0.png resize: (169, 289) 1396385949 -4.727807797024822 treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235062_0.png resize: (325, 495) 1396385950 -4.718150214686697 treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235065_0.png resize: (434, 305) 1396385951 -4.749900248864508 treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235066_0.png resize: (468, 457) 1396385952 -5.630379592994329 treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235067_0.png resize: (353, 409) 1396385953 -2.3262398118714467 treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235070_0.png resize: (146, 171) 1396385954 -4.925577477211546 treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235071_0.png resize: (68, 193) 1396385955 -2.6219197545010315 treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235072_0.png resize: (259, 176) 1396385956 -4.5488202735315175 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235079_0.png resize: (71, 131) 1396385957 -3.352899272417904 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235080_0.png resize: (304, 211) 1396385958 -3.787738973347838 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235084_0.png resize: (309, 370) 1396385959 -3.790126589565345 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235085_0.png resize: (230, 350) 1396385960 -3.535252951797576 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235089_0.png resize: (209, 363) 1396385961 -3.4957035156528478 treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235092_0.png resize: (319, 433) 1396385962 -3.075983472296169 treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235093_0.png resize: (167, 132) 1396385963 -2.8138604549927106 treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235094_0.png resize: (104, 144) 1396385964 -4.177320308751759 treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235095_0.png resize: (266, 292) 1396385965 -4.379720836904049 treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235096_0.png resize: (364, 722) 1396385966 -4.012699292764816 treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235097_0.png resize: (478, 504) 1396385967 -5.4473297395445615 treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235034_0.png resize: (114, 129) 1396385969 -3.5277245855236283 treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235040_0.png resize: (309, 285) 1396385970 -2.4000539950482453 treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235056_0.png resize: (105, 203) 1396385971 -3.391826721501851 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235076_0.png resize: (129, 146) 1396385972 -3.7130817437900343 treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235078_0.png resize: (99, 105) 1396385973 -3.520735105485241 treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235087_0.png resize: (186, 210) 1396385974 -3.671032617110776 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 97 time used for this insertion : 0.017904281616210938 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 97 time used for this insertion : 0.0188446044921875 save missing photos in datou_result : time spend for datou_step_exec : 42.04145932197571 time spend to save output : 0.04315185546875 total time spend for step 6 : 42.08461117744446 step7:brightness Thu Nov 27 09:44:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76.jpg treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496.jpg treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1.jpg treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718.jpg treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae.jpg treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b.jpg treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef.jpg treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800.jpg treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda.jpg treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72.jpg treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037.jpg treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235012_0.png treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235014_0.png treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235015_0.png treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235017_0.png treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235018_0.png treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235019_0.png treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235021_0.png treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235022_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235029_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235031_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235033_0.png treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235039_0.png treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235046_0.png treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235048_0.png treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235054_0.png treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235055_0.png treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235060_0.png treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235064_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235073_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235074_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235077_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235082_0.png treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235083_0.png treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235088_0.png treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235090_0.png treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235091_0.png treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235013_0.png treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235023_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235026_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235037_0.png treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235038_0.png treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235052_0.png treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235063_0.png treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235068_0.png treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235069_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235081_0.png treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235086_0.png treat image : temp/1764232829_1951098_1396378658_6b3140dc505ef542a2aa8a66042ebc76_rle_crop_4047235016_0.png treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235020_0.png treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235024_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235032_0.png treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235042_0.png treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235045_0.png treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235049_0.png treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235050_0.png treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235051_0.png treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235057_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235075_0.png treat image : temp/1764232829_1951098_1396378655_15aefafc9f6aca593a3b5c260c087496_rle_crop_4047235025_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235027_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235028_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235030_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235035_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235036_0.png treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235041_0.png treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235043_0.png treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235044_0.png treat image : temp/1764232829_1951098_1396378631_a71ca0241b88bfad499bab8ea1d85eae_rle_crop_4047235047_0.png treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235053_0.png treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235058_0.png treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235059_0.png treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235061_0.png treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235062_0.png treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235065_0.png treat image : temp/1764232829_1951098_1396378581_75f4f410d53c59475f1c343478aaa7ef_rle_crop_4047235066_0.png treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235067_0.png treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235070_0.png treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235071_0.png treat image : temp/1764232829_1951098_1396378546_cda8b679e17b6a492f9410adff0ef800_rle_crop_4047235072_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235079_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235080_0.png treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235084_0.png treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235085_0.png treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235089_0.png treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235092_0.png treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235093_0.png treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235094_0.png treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235095_0.png treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235096_0.png treat image : temp/1764232829_1951098_1396378432_65111171ff26825944d9ff9978610037_rle_crop_4047235097_0.png treat image : temp/1764232829_1951098_1396378651_c7beea7e28e0ad949074dc909b7faaa1_rle_crop_4047235034_0.png treat image : temp/1764232829_1951098_1396378645_4a6a7059e6e5a9c1f7393fee87e49718_rle_crop_4047235040_0.png treat image : temp/1764232829_1951098_1396378617_6d24237294cff0c323f5c53175e4364b_rle_crop_4047235056_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235076_0.png treat image : temp/1764232829_1951098_1396378505_96e9a0e6295c2e57baa61c1b02099bda_rle_crop_4047235078_0.png treat image : temp/1764232829_1951098_1396378468_055229e3fd41185bafd026837cf6ee72_rle_crop_4047235087_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 97 time used for this insertion : 0.02005171775817871 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 97 time used for this insertion : 0.02019190788269043 save missing photos in datou_result : time spend for datou_step_exec : 10.991560220718384 time spend to save output : 0.04643392562866211 total time spend for step 7 : 11.037994146347046 step8:velours_tree Thu Nov 27 09:44:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09730100631713867 time spend to save output : 4.1961669921875e-05 total time spend for step 8 : 0.09734296798706055 step9:send_mail_cod Thu Nov 27 09:44:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28957702_27-11-2025_09_44_24.pdf 28958030 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289580301764233064 28958031 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289580311764233066 28958032 imagette289580321764233067 28958033 imagette289580331764233067 28958034 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289580341764233067 28958035 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289580351764233068 28958036 imagette289580361764233069 28958037 imagette289580371764233069 28958039 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289580391764233069 28958040 imagette289580401764233071 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28957702 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28958030,28958031,28958032,28958033,28958034,28958035,28958036,28958037,28958038,28958039,28958040?tags=papier,carton,mal_croppe,flou,autre,metal,pehd,background,environnement,pet_clair,pet_fonce args[1396378658] : ((1396378658, -4.297820206857421, 492609224), (1396378658, -1.559280520448798, 501862349), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378655] : ((1396378655, -6.360074385154958, 492609224), (1396378655, -0.5106129125176704, 501862349), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378651] : ((1396378651, -6.303489435080449, 492609224), (1396378651, -0.41610540759712783, 496442774), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378645] : ((1396378645, -6.154775152984089, 492609224), (1396378645, -0.5291308643995346, 501862349), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378631] : ((1396378631, -6.242075023693626, 492609224), (1396378631, -0.6813312960006551, 501862349), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378617] : ((1396378617, -6.188439159339109, 492609224), (1396378617, -0.34693662074853204, 496442774), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378581] : ((1396378581, -6.133988361058775, 492609224), (1396378581, -0.32338068099588646, 496442774), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378546] : ((1396378546, -6.3605810866699555, 492609224), (1396378546, -0.33959919860396853, 496442774), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378505] : ((1396378505, -6.373693434199459, 492609224), (1396378505, -0.2658864778792018, 496442774), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378468] : ((1396378468, -6.2432907055642755, 492609224), (1396378468, -0.4081366403741831, 496442774), '0.056449060921717184') We are sending mail with results at report@fotonower.com args[1396378432] : ((1396378432, -6.234741757463007, 492609224), (1396378432, -0.3097686445449969, 496442774), '0.056449060921717184') We are sending mail with results at report@fotonower.com refus_total : 0.056449060921717184 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28957702 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28957702_27-11-2025_09_44_24.pdf results_Auto_P28957702_27-11-2025_09_44_24.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28957702_27-11-2025_09_44_24.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28957702','results_Auto_P28957702_27-11-2025_09_44_24.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28957702_27-11-2025_09_44_24.pdf','pdf','','0.76','0.056449060921717184') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28957702

https://www.fotonower.com/image?json=false&list_photos_id=1396378658
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378655
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378651
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378645
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378631
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378617
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378581
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378546
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378505
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378468
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396378432
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.64%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28958030?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28958031?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28958034?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28958035?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28958039?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28957702_27-11-2025_09_44_24.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28958030,28958031,28958032,28958033,28958034,28958035,28958036,28958037,28958038,28958039,28958040?tags=papier,carton,mal_croppe,flou,autre,metal,pehd,background,environnement,pet_clair,pet_fonce.


L'équipe Fotonower HTTP Error 401: Unauthorized Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1396378658, 1396378655, 1396378651, 1396378645, 1396378631, 1396378617, 1396378581, 1396378546, 1396378505, 1396378468, 1396378432] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378658', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378655', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378651', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378645', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378631', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378617', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378581', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378546', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378505', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378468', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378432', None, None, None, None, None, '4128350') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016187429428100586 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.149094343185425 time spend to save output : 0.016472816467285156 total time spend for step 9 : 9.16556715965271 step10:split_time_score Thu Nov 27 09:44:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27112025 28957702 Nombre de photos uploadées : 11 / 23040 (0%) 27112025 28957702 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 27112025 28957702 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005970001220703125 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23133397102355957 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.006490990150750416 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28953568_27-11-2025_07_20_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28953568 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28953568 AND mptpi.`type`=3726 To do Qualite : 0.02941774797609571 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28953595_27-11-2025_08_18_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28953595 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28953595 AND mptpi.`type`=3726 To do Qualite : 0.04225312514381523 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28955895_27-11-2025_08_44_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28955895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28955895 AND mptpi.`type`=3726 To do Qualite : 0.027723230500646342 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28957700_27-11-2025_09_38_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28957700 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28957700 AND mptpi.`type`=3726 To do Qualite : 0.056449060921717184 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28957702_27-11-2025_09_44_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28957702 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28957702 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27112025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1396378658, 1396378655, 1396378651, 1396378645, 1396378631, 1396378617, 1396378581, 1396378546, 1396378505, 1396378468, 1396378432] Looping around the photos to save general results len do output : 1 /28957702Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378658', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378655', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378651', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378645', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378631', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378617', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378581', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378546', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378505', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378468', None, None, None, None, None, '4128350') ('3318', None, None, None, None, None, None, None, '4128350') ('3318', '28957702', '1396378432', None, None, None, None, None, '4128350') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016684770584106445 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8071062564849854 time spend to save output : 0.016901016235351562 total time spend for step 10 : 0.8240072727203369 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 117.51user 96.62system 4:09.21elapsed 85%CPU (0avgtext+0avgdata 4900052maxresident)k 582280inputs+116992outputs (2409major+11856577minor)pagefaults 0swaps