python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 827446 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3971899'] with mtr_portfolio_ids : ['28008658'] and first list_photo_ids : [] new path : /proc/827446/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 3.768345832824707 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 31 09:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-31 09:20:34.466401: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-31 09:20:34.494469: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-31 09:20:34.496118: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efb4c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-31 09:20:34.496168: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-31 09:20:34.498720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-31 09:20:34.726585: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x10a31e40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-31 09:20:34.726633: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-31 09:20:34.727422: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 09:20:34.727763: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 09:20:34.729720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 09:20:34.731759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 09:20:34.732087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 09:20:34.734237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 09:20:34.735353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 09:20:34.741042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 09:20:34.742515: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 09:20:34.742596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 09:20:34.743340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 09:20:34.743355: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 09:20:34.743364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 09:20:34.744911: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-31 09:20:34.994381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 09:20:34.994479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 09:20:34.994497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 09:20:34.994512: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 09:20:34.994527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 09:20:34.994542: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 09:20:34.994556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 09:20:34.994571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 09:20:34.995914: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 09:20:34.997395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 09:20:34.997479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 09:20:34.997497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 09:20:34.997511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 09:20:34.997525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 09:20:34.997539: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 09:20:34.997553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 09:20:34.997567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 09:20:34.998998: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 09:20:34.999048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 09:20:34.999059: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 09:20:34.999067: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 09:20:35.000805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-31 09:20:45.933129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 09:20:46.323678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 Detection mask done ! Trying to reset tf kernel 828052 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1487 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6776 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010056495666503906 nb_pixel_total : 16156 time to create 1 rle with old method : 0.02442455291748047 length of segment : 208 time for calcul the mask position with numpy : 0.000997781753540039 nb_pixel_total : 33673 time to create 1 rle with old method : 0.054988861083984375 length of segment : 303 time for calcul the mask position with numpy : 0.0017845630645751953 nb_pixel_total : 82423 time to create 1 rle with old method : 0.09520840644836426 length of segment : 338 time for calcul the mask position with numpy : 0.0010800361633300781 nb_pixel_total : 58799 time to create 1 rle with old method : 0.06818914413452148 length of segment : 558 time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 25462 time to create 1 rle with old method : 0.028911352157592773 length of segment : 170 time for calcul the mask position with numpy : 0.00026535987854003906 nb_pixel_total : 14266 time to create 1 rle with old method : 0.020992040634155273 length of segment : 120 time for calcul the mask position with numpy : 0.0004673004150390625 nb_pixel_total : 24087 time to create 1 rle with old method : 0.03888964653015137 length of segment : 179 time for calcul the mask position with numpy : 0.0015578269958496094 nb_pixel_total : 88314 time to create 1 rle with old method : 0.10698175430297852 length of segment : 405 time for calcul the mask position with numpy : 0.0003066062927246094 nb_pixel_total : 16029 time to create 1 rle with old method : 0.018632173538208008 length of segment : 122 time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 7325 time to create 1 rle with old method : 0.008707761764526367 length of segment : 101 time for calcul the mask position with numpy : 0.0004069805145263672 nb_pixel_total : 27483 time to create 1 rle with old method : 0.031202077865600586 length of segment : 167 time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 21090 time to create 1 rle with old method : 0.024265527725219727 length of segment : 160 time for calcul the mask position with numpy : 0.0005400180816650391 nb_pixel_total : 29356 time to create 1 rle with old method : 0.035306692123413086 length of segment : 200 time for calcul the mask position with numpy : 0.0015201568603515625 nb_pixel_total : 59699 time to create 1 rle with old method : 0.07238173484802246 length of segment : 357 time for calcul the mask position with numpy : 0.0004930496215820312 nb_pixel_total : 20280 time to create 1 rle with old method : 0.0257413387298584 length of segment : 174 time for calcul the mask position with numpy : 0.001352548599243164 nb_pixel_total : 54411 time to create 1 rle with old method : 0.07012081146240234 length of segment : 180 time for calcul the mask position with numpy : 0.0032334327697753906 nb_pixel_total : 121764 time to create 1 rle with old method : 0.15695595741271973 length of segment : 426 time for calcul the mask position with numpy : 0.0005772113800048828 nb_pixel_total : 23756 time to create 1 rle with old method : 0.027100563049316406 length of segment : 245 time for calcul the mask position with numpy : 0.0014417171478271484 nb_pixel_total : 66725 time to create 1 rle with old method : 0.0784304141998291 length of segment : 264 time for calcul the mask position with numpy : 0.0005333423614501953 nb_pixel_total : 15676 time to create 1 rle with old method : 0.027158260345458984 length of segment : 175 time for calcul the mask position with numpy : 0.0006732940673828125 nb_pixel_total : 27995 time to create 1 rle with old method : 0.032266855239868164 length of segment : 164 time for calcul the mask position with numpy : 0.0027418136596679688 nb_pixel_total : 132903 time to create 1 rle with old method : 0.18703389167785645 length of segment : 288 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 15867 time to create 1 rle with old method : 0.018130779266357422 length of segment : 143 time for calcul the mask position with numpy : 0.0008234977722167969 nb_pixel_total : 50123 time to create 1 rle with old method : 0.05687665939331055 length of segment : 265 time for calcul the mask position with numpy : 0.00029778480529785156 nb_pixel_total : 14430 time to create 1 rle with old method : 0.017252445220947266 length of segment : 125 time for calcul the mask position with numpy : 0.00032258033752441406 nb_pixel_total : 14832 time to create 1 rle with old method : 0.016875267028808594 length of segment : 200 time for calcul the mask position with numpy : 0.0003228187561035156 nb_pixel_total : 14534 time to create 1 rle with old method : 0.018588781356811523 length of segment : 157 time for calcul the mask position with numpy : 0.0013422966003417969 nb_pixel_total : 58561 time to create 1 rle with old method : 0.07035160064697266 length of segment : 337 time for calcul the mask position with numpy : 0.0003955364227294922 nb_pixel_total : 20754 time to create 1 rle with old method : 0.023392438888549805 length of segment : 174 time for calcul the mask position with numpy : 0.0005950927734375 nb_pixel_total : 39914 time to create 1 rle with old method : 0.04557681083679199 length of segment : 289 time for calcul the mask position with numpy : 0.00020003318786621094 nb_pixel_total : 11612 time to create 1 rle with old method : 0.01358795166015625 length of segment : 72 time for calcul the mask position with numpy : 0.0006582736968994141 nb_pixel_total : 52330 time to create 1 rle with old method : 0.060303449630737305 length of segment : 187 time for calcul the mask position with numpy : 0.0010597705841064453 nb_pixel_total : 82757 time to create 1 rle with old method : 0.0941319465637207 length of segment : 292 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 11485 time to create 1 rle with old method : 0.013422250747680664 length of segment : 127 time for calcul the mask position with numpy : 0.0006213188171386719 nb_pixel_total : 38734 time to create 1 rle with old method : 0.04743671417236328 length of segment : 225 time for calcul the mask position with numpy : 0.00018167495727539062 nb_pixel_total : 9474 time to create 1 rle with old method : 0.011210203170776367 length of segment : 90 time for calcul the mask position with numpy : 0.0001983642578125 nb_pixel_total : 11737 time to create 1 rle with old method : 0.013971805572509766 length of segment : 122 time for calcul the mask position with numpy : 0.0004076957702636719 nb_pixel_total : 21973 time to create 1 rle with old method : 0.03223824501037598 length of segment : 129 time for calcul the mask position with numpy : 0.00026154518127441406 nb_pixel_total : 11439 time to create 1 rle with old method : 0.013418436050415039 length of segment : 145 time for calcul the mask position with numpy : 0.0007441043853759766 nb_pixel_total : 36390 time to create 1 rle with old method : 0.10835838317871094 length of segment : 239 time for calcul the mask position with numpy : 0.0004248619079589844 nb_pixel_total : 13218 time to create 1 rle with old method : 0.023792266845703125 length of segment : 166 time for calcul the mask position with numpy : 0.0004961490631103516 nb_pixel_total : 18779 time to create 1 rle with old method : 0.042581796646118164 length of segment : 133 time for calcul the mask position with numpy : 0.001504659652709961 nb_pixel_total : 35422 time to create 1 rle with old method : 0.06524848937988281 length of segment : 276 time for calcul the mask position with numpy : 0.0018510818481445312 nb_pixel_total : 33125 time to create 1 rle with old method : 0.06051301956176758 length of segment : 379 time for calcul the mask position with numpy : 0.007723331451416016 nb_pixel_total : 211096 time to create 1 rle with new method : 0.02113175392150879 length of segment : 722 time for calcul the mask position with numpy : 0.0006806850433349609 nb_pixel_total : 31025 time to create 1 rle with old method : 0.035920143127441406 length of segment : 362 time for calcul the mask position with numpy : 0.0005137920379638672 nb_pixel_total : 18034 time to create 1 rle with old method : 0.02678227424621582 length of segment : 311 time for calcul the mask position with numpy : 0.001024484634399414 nb_pixel_total : 67180 time to create 1 rle with old method : 0.07520866394042969 length of segment : 342 time for calcul the mask position with numpy : 0.0019683837890625 nb_pixel_total : 55806 time to create 1 rle with old method : 0.06279611587524414 length of segment : 339 time for calcul the mask position with numpy : 0.00218963623046875 nb_pixel_total : 53585 time to create 1 rle with old method : 0.07989501953125 length of segment : 302 time for calcul the mask position with numpy : 0.0010242462158203125 nb_pixel_total : 27454 time to create 1 rle with old method : 0.031116485595703125 length of segment : 180 time for calcul the mask position with numpy : 0.0005409717559814453 nb_pixel_total : 15640 time to create 1 rle with old method : 0.018076419830322266 length of segment : 147 time for calcul the mask position with numpy : 0.0008471012115478516 nb_pixel_total : 21826 time to create 1 rle with old method : 0.02519989013671875 length of segment : 208 time for calcul the mask position with numpy : 0.0007541179656982422 nb_pixel_total : 27927 time to create 1 rle with old method : 0.03206610679626465 length of segment : 183 time for calcul the mask position with numpy : 0.00857400894165039 nb_pixel_total : 104040 time to create 1 rle with old method : 0.11708450317382812 length of segment : 458 time for calcul the mask position with numpy : 0.0017383098602294922 nb_pixel_total : 61143 time to create 1 rle with old method : 0.07323598861694336 length of segment : 272 time for calcul the mask position with numpy : 0.0011713504791259766 nb_pixel_total : 34332 time to create 1 rle with old method : 0.037300825119018555 length of segment : 256 time for calcul the mask position with numpy : 0.0005254745483398438 nb_pixel_total : 35779 time to create 1 rle with old method : 0.039991140365600586 length of segment : 204 time for calcul the mask position with numpy : 0.0004067420959472656 nb_pixel_total : 26178 time to create 1 rle with old method : 0.028989076614379883 length of segment : 176 time for calcul the mask position with numpy : 0.0017457008361816406 nb_pixel_total : 99312 time to create 1 rle with old method : 0.10910153388977051 length of segment : 368 time for calcul the mask position with numpy : 0.0011839866638183594 nb_pixel_total : 14064 time to create 1 rle with old method : 0.01700592041015625 length of segment : 326 time for calcul the mask position with numpy : 0.0019092559814453125 nb_pixel_total : 47127 time to create 1 rle with old method : 0.05617547035217285 length of segment : 253 time for calcul the mask position with numpy : 0.0029473304748535156 nb_pixel_total : 89576 time to create 1 rle with old method : 0.12024116516113281 length of segment : 377 time for calcul the mask position with numpy : 0.00046324729919433594 nb_pixel_total : 10945 time to create 1 rle with old method : 0.012726068496704102 length of segment : 100 time for calcul the mask position with numpy : 0.002419710159301758 nb_pixel_total : 70982 time to create 1 rle with old method : 0.0820016860961914 length of segment : 336 time for calcul the mask position with numpy : 0.0015370845794677734 nb_pixel_total : 44164 time to create 1 rle with old method : 0.05013775825500488 length of segment : 260 time for calcul the mask position with numpy : 0.002476930618286133 nb_pixel_total : 47988 time to create 1 rle with old method : 0.05578899383544922 length of segment : 367 time for calcul the mask position with numpy : 0.001954793930053711 nb_pixel_total : 40962 time to create 1 rle with old method : 0.04689645767211914 length of segment : 228 time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 14391 time to create 1 rle with old method : 0.017107009887695312 length of segment : 164 time for calcul the mask position with numpy : 0.0010509490966796875 nb_pixel_total : 21725 time to create 1 rle with old method : 0.025492429733276367 length of segment : 199 time for calcul the mask position with numpy : 0.0007548332214355469 nb_pixel_total : 17028 time to create 1 rle with old method : 0.027065515518188477 length of segment : 141 time for calcul the mask position with numpy : 0.00026607513427734375 nb_pixel_total : 3477 time to create 1 rle with old method : 0.004358530044555664 length of segment : 57 time for calcul the mask position with numpy : 0.001049041748046875 nb_pixel_total : 32339 time to create 1 rle with old method : 0.036652326583862305 length of segment : 228 time for calcul the mask position with numpy : 0.0005538463592529297 nb_pixel_total : 13452 time to create 1 rle with old method : 0.015712976455688477 length of segment : 195 time for calcul the mask position with numpy : 0.0007493495941162109 nb_pixel_total : 21641 time to create 1 rle with old method : 0.024847984313964844 length of segment : 209 time for calcul the mask position with numpy : 0.0004658699035644531 nb_pixel_total : 11074 time to create 1 rle with old method : 0.019072771072387695 length of segment : 103 time for calcul the mask position with numpy : 0.0005328655242919922 nb_pixel_total : 11774 time to create 1 rle with old method : 0.01992344856262207 length of segment : 124 time for calcul the mask position with numpy : 0.002882242202758789 nb_pixel_total : 84062 time to create 1 rle with old method : 0.09412479400634766 length of segment : 318 time for calcul the mask position with numpy : 0.0029757022857666016 nb_pixel_total : 65371 time to create 1 rle with old method : 0.07496333122253418 length of segment : 283 time for calcul the mask position with numpy : 0.0014431476593017578 nb_pixel_total : 44517 time to create 1 rle with old method : 0.05206871032714844 length of segment : 237 time for calcul the mask position with numpy : 0.0010707378387451172 nb_pixel_total : 22194 time to create 1 rle with old method : 0.02604985237121582 length of segment : 171 time for calcul the mask position with numpy : 0.0006337165832519531 nb_pixel_total : 15028 time to create 1 rle with old method : 0.01770472526550293 length of segment : 120 time for calcul the mask position with numpy : 0.0005633831024169922 nb_pixel_total : 11066 time to create 1 rle with old method : 0.01296377182006836 length of segment : 141 time spent for convertir_results : 7.393405199050903 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 83 chid ids of type : 3594 Number RLEs to save : 19343 save missing photos in datou_result : time spend for datou_step_exec : 57.49275279045105 time spend to save output : 1.1073188781738281 total time spend for step 1 : 58.60007166862488 step2:crop_condition Fri Oct 31 09:21:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 83 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3736932 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761898900_827446 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938030_0.png', 0, 158, 207, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938031_0.png', 0, 223, 297, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938032_0.png', 0, 605, 237, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938034_0.png', 0, 211, 170, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938035_0.png', 0, 154, 120, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938039_0.png', 0, 95, 101, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938042_0.png', 0, 230, 194, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938043_0.png', 0, 307, 291, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938044_0.png', 0, 138, 171, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938047_0.png', 0, 159, 245, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938052_0.png', 0, 188, 127, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938053_0.png', 0, 275, 236, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938054_0.png', 0, 175, 125, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938055_0.png', 0, 96, 193, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938059_0.png', 0, 191, 274, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938060_0.png', 0, 208, 72, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938064_0.png', 0, 277, 208, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938065_0.png', 0, 126, 88, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938066_0.png', 0, 131, 122, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938067_0.png', 0, 249, 127, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938068_0.png', 0, 113, 130, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938069_0.png', 0, 236, 236, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938070_0.png', 0, 135, 166, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938071_0.png', 0, 174, 132, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938073_0.png', 0, 230, 276, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938074_0.png', 0, 561, 654, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938076_0.png', 0, 160, 170, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938078_0.png', 0, 339, 320, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938079_0.png', 0, 321, 302, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938080_0.png', 0, 240, 180, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938081_0.png', 0, 174, 123, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938082_0.png', 0, 125, 208, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938083_0.png', 0, 204, 183, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938084_0.png', 0, 555, 293, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938087_0.png', 0, 258, 204, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938089_0.png', 0, 485, 368, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938092_0.png', 0, 377, 376, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938093_0.png', 0, 157, 100, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938094_0.png', 0, 405, 336, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938098_0.png', 0, 153, 163, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938101_0.png', 0, 99, 54, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938103_0.png', 0, 144, 155, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938104_0.png', 0, 151, 209, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938107_0.png', 0, 338, 315, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938109_0.png', 0, 332, 229, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938111_0.png', 0, 169, 120, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898910), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938112_0.png', 0, 137, 141, 0, 1761898910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 47 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.00598955154419 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761898915_827446 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938036_0.png', 0, 168, 179, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938040_0.png', 0, 199, 167, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938041_0.png', 0, 191, 160, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938049_0.png', 0, 184, 147, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938056_0.png', 0, 141, 150, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938061_0.png', 0, 348, 186, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938086_0.png', 0, 234, 217, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938088_0.png', 0, 205, 176, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938095_0.png', 0, 243, 258, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938097_0.png', 0, 330, 219, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898918), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938102_0.png', 0, 264, 224, 0, 1761898918,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.2435920238494873 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761898921_827446 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898922), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938038_0.png', 0, 175, 122, 0, 1761898922,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898922), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938058_0.png', 0, 142, 173, 0, 1761898922,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898922), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938063_0.png', 0, 134, 120, 0, 1761898922,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898922), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938099_0.png', 0, 158, 199, 0, 1761898922,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898922), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938100_0.png', 0, 153, 141, 0, 1761898922,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898922), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938105_0.png', 0, 162, 88, 0, 1761898922,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898922), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938106_0.png', 0, 118, 124, 0, 1761898922,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898922), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938110_0.png', 0, 182, 169, 0, 1761898922,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.727552890777588 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761898927_827446 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938033_0.png', 0, 152, 488, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938037_0.png', 0, 315, 404, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938045_0.png', 0, 477, 166, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938046_0.png', 0, 458, 407, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938048_0.png', 0, 527, 214, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938050_0.png', 0, 268, 164, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938051_0.png', 0, 549, 284, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938057_0.png', 0, 247, 336, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938062_0.png', 0, 411, 284, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938072_0.png', 0, 188, 264, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938075_0.png', 0, 217, 236, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898930), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938108_0.png', 0, 323, 278, 0, 1761898930,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.289717674255371 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761898933_827446 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898933), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938090_0.png', 0, 463, 168, 0, 1761898933,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5379207134246826 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761898935_827446 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898936), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938077_0.png', 0, 250, 339, 0, 1761898936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898936), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938085_0.png', 0, 313, 272, 0, 1761898936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898936), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938091_0.png', 0, 234, 242, 0, 1761898936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761898936), 0.0, 0.0, 14, '', 0, 0, '1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938096_0.png', 0, 256, 367, 0, 1761898936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3493432998657227 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1390139683, 1390139682, 1390139681, 1390139680, 1390139679, 1390139678, 1390139676, 1390139675, 1390139674, 1390139672, 1390139671] Looping around the photos to save general results len do output : 83 /1391056644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391056962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391057000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391057032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391057033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391057034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391057035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139683', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139682', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139681', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139680', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139679', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139678', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139676', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139675', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139674', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139672', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139671', None, None, None, None, None, '3971899') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 260 time used for this insertion : 0.03353166580200195 save_final save missing photos in datou_result : time spend for datou_step_exec : 46.77211618423462 time spend to save output : 0.03592252731323242 total time spend for step 2 : 46.80803871154785 step3:rle_unique_nms_with_priority Fri Oct 31 09:22:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 83 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 1.6639246940612793 time for calcul the mask position with numpy : 0.5299568176269531 nb_pixel_total : 8063621 time to create 1 rle with new method : 0.5610084533691406 time for calcul the mask position with numpy : 0.02329730987548828 nb_pixel_total : 14266 time to create 1 rle with old method : 0.015596151351928711 time for calcul the mask position with numpy : 0.0239717960357666 nb_pixel_total : 25462 time to create 1 rle with old method : 0.028855323791503906 time for calcul the mask position with numpy : 0.02545452117919922 nb_pixel_total : 58799 time to create 1 rle with old method : 0.0663304328918457 time for calcul the mask position with numpy : 0.025821685791015625 nb_pixel_total : 82423 time to create 1 rle with old method : 0.09028220176696777 time for calcul the mask position with numpy : 0.0262911319732666 nb_pixel_total : 33673 time to create 1 rle with old method : 0.05380821228027344 time for calcul the mask position with numpy : 0.02800583839416504 nb_pixel_total : 16156 time to create 1 rle with old method : 0.018329858779907227 create new chi : 1.5557196140289307 time to delete rle : 0.018213510513305664 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5554 TO DO : save crop sub photo not yet done ! save time : 0.35683560371398926 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 4.428975343704224 time for calcul the mask position with numpy : 0.6044042110443115 nb_pixel_total : 7824562 time to create 1 rle with new method : 0.9765615463256836 time for calcul the mask position with numpy : 0.02417135238647461 nb_pixel_total : 121764 time to create 1 rle with old method : 0.12767696380615234 time for calcul the mask position with numpy : 0.02591395378112793 nb_pixel_total : 54411 time to create 1 rle with old method : 0.06188631057739258 time for calcul the mask position with numpy : 0.02505040168762207 nb_pixel_total : 20280 time to create 1 rle with old method : 0.0229644775390625 time for calcul the mask position with numpy : 0.02839946746826172 nb_pixel_total : 59699 time to create 1 rle with old method : 0.0659027099609375 time for calcul the mask position with numpy : 0.027415990829467773 nb_pixel_total : 29356 time to create 1 rle with old method : 0.03323698043823242 time for calcul the mask position with numpy : 0.025809764862060547 nb_pixel_total : 21090 time to create 1 rle with old method : 0.023479938507080078 time for calcul the mask position with numpy : 0.0269925594329834 nb_pixel_total : 27483 time to create 1 rle with old method : 0.03043818473815918 time for calcul the mask position with numpy : 0.025358915328979492 nb_pixel_total : 7325 time to create 1 rle with old method : 0.008185386657714844 time for calcul the mask position with numpy : 0.026471614837646484 nb_pixel_total : 16029 time to create 1 rle with old method : 0.01743030548095703 time for calcul the mask position with numpy : 0.025789976119995117 nb_pixel_total : 88314 time to create 1 rle with old method : 0.0939934253692627 time for calcul the mask position with numpy : 0.02333354949951172 nb_pixel_total : 24087 time to create 1 rle with old method : 0.025299549102783203 create new chi : 2.4179790019989014 time to delete rle : 0.0008988380432128906 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 7102 TO DO : save crop sub photo not yet done ! save time : 0.4169423580169678 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.583645820617676 time for calcul the mask position with numpy : 0.5317206382751465 nb_pixel_total : 7961355 time to create 1 rle with new method : 0.6980817317962646 time for calcul the mask position with numpy : 0.02397012710571289 nb_pixel_total : 50123 time to create 1 rle with old method : 0.05359315872192383 time for calcul the mask position with numpy : 0.023445606231689453 nb_pixel_total : 15867 time to create 1 rle with old method : 0.0174405574798584 time for calcul the mask position with numpy : 0.0317234992980957 nb_pixel_total : 132903 time to create 1 rle with old method : 0.14473915100097656 time for calcul the mask position with numpy : 0.0413665771484375 nb_pixel_total : 27995 time to create 1 rle with old method : 0.030094385147094727 time for calcul the mask position with numpy : 0.03926849365234375 nb_pixel_total : 15676 time to create 1 rle with old method : 0.01874375343322754 time for calcul the mask position with numpy : 0.023134469985961914 nb_pixel_total : 66725 time to create 1 rle with old method : 0.07205557823181152 time for calcul the mask position with numpy : 0.024686813354492188 nb_pixel_total : 23756 time to create 1 rle with old method : 0.024529695510864258 create new chi : 1.8395705223083496 time to delete rle : 0.0006895065307617188 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5248 TO DO : save crop sub photo not yet done ! save time : 0.3077869415283203 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 2.623260736465454 time for calcul the mask position with numpy : 0.5286009311676025 nb_pixel_total : 8119763 time to create 1 rle with new method : 0.5953140258789062 time for calcul the mask position with numpy : 0.022840499877929688 nb_pixel_total : 11612 time to create 1 rle with old method : 0.012329339981079102 time for calcul the mask position with numpy : 0.02285027503967285 nb_pixel_total : 39914 time to create 1 rle with old method : 0.04206442832946777 time for calcul the mask position with numpy : 0.02321767807006836 nb_pixel_total : 20754 time to create 1 rle with old method : 0.022099971771240234 time for calcul the mask position with numpy : 0.023292064666748047 nb_pixel_total : 58561 time to create 1 rle with old method : 0.06078958511352539 time for calcul the mask position with numpy : 0.02253890037536621 nb_pixel_total : 14534 time to create 1 rle with old method : 0.014917850494384766 time for calcul the mask position with numpy : 0.02377462387084961 nb_pixel_total : 14832 time to create 1 rle with old method : 0.016258955001831055 time for calcul the mask position with numpy : 0.023474693298339844 nb_pixel_total : 14430 time to create 1 rle with old method : 0.014990568161010742 create new chi : 1.5112590789794922 time to delete rle : 0.0006444454193115234 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 4868 TO DO : save crop sub photo not yet done ! save time : 0.31496357917785645 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 2.257128953933716 time for calcul the mask position with numpy : 0.4864020347595215 nb_pixel_total : 8087883 time to create 1 rle with new method : 0.7167525291442871 time for calcul the mask position with numpy : 0.02362990379333496 nb_pixel_total : 11737 time to create 1 rle with old method : 0.012837409973144531 time for calcul the mask position with numpy : 0.02372145652770996 nb_pixel_total : 9474 time to create 1 rle with old method : 0.010560750961303711 time for calcul the mask position with numpy : 0.023726701736450195 nb_pixel_total : 38734 time to create 1 rle with old method : 0.04192638397216797 time for calcul the mask position with numpy : 0.02344799041748047 nb_pixel_total : 11485 time to create 1 rle with old method : 0.012486696243286133 time for calcul the mask position with numpy : 0.024895668029785156 nb_pixel_total : 82757 time to create 1 rle with old method : 0.08878874778747559 time for calcul the mask position with numpy : 0.025461435317993164 nb_pixel_total : 52330 time to create 1 rle with old method : 0.056427717208862305 create new chi : 1.6144227981567383 time to delete rle : 0.0005741119384765625 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 4246 TO DO : save crop sub photo not yet done ! save time : 0.2650618553161621 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 4.1922385692596436 time for calcul the mask position with numpy : 0.6557011604309082 nb_pixel_total : 7801840 time to create 1 rle with new method : 0.5427999496459961 time for calcul the mask position with numpy : 0.02379012107849121 nb_pixel_total : 67180 time to create 1 rle with old method : 0.07285618782043457 time for calcul the mask position with numpy : 0.024327754974365234 nb_pixel_total : 13263 time to create 1 rle with old method : 0.014668464660644531 time for calcul the mask position with numpy : 0.025151491165161133 nb_pixel_total : 31025 time to create 1 rle with old method : 0.03260946273803711 time for calcul the mask position with numpy : 0.025502443313598633 nb_pixel_total : 211096 time to create 1 rle with new method : 0.5278310775756836 time for calcul the mask position with numpy : 0.027296781539916992 nb_pixel_total : 33125 time to create 1 rle with old method : 0.03699779510498047 time for calcul the mask position with numpy : 0.03210186958312988 nb_pixel_total : 35422 time to create 1 rle with old method : 0.03883695602416992 time for calcul the mask position with numpy : 0.024885892868041992 nb_pixel_total : 18779 time to create 1 rle with old method : 0.02021932601928711 time for calcul the mask position with numpy : 0.02472066879272461 nb_pixel_total : 12868 time to create 1 rle with old method : 0.014055967330932617 time for calcul the mask position with numpy : 0.02850961685180664 nb_pixel_total : 36390 time to create 1 rle with old method : 0.03961372375488281 time for calcul the mask position with numpy : 0.026289701461791992 nb_pixel_total : 11439 time to create 1 rle with old method : 0.012195587158203125 time for calcul the mask position with numpy : 0.024587392807006836 nb_pixel_total : 21973 time to create 1 rle with old method : 0.023606300354003906 create new chi : 2.3917179107666016 time to delete rle : 0.001102447509765625 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8236 TO DO : save crop sub photo not yet done ! save time : 0.4669055938720703 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.17419171333313 time for calcul the mask position with numpy : 0.6022317409515381 nb_pixel_total : 7892647 time to create 1 rle with new method : 0.7536895275115967 time for calcul the mask position with numpy : 0.024099349975585938 nb_pixel_total : 34332 time to create 1 rle with old method : 0.0369715690612793 time for calcul the mask position with numpy : 0.03223013877868652 nb_pixel_total : 61143 time to create 1 rle with old method : 0.06617593765258789 time for calcul the mask position with numpy : 0.04079461097717285 nb_pixel_total : 104040 time to create 1 rle with old method : 0.11186432838439941 time for calcul the mask position with numpy : 0.03817152976989746 nb_pixel_total : 27927 time to create 1 rle with old method : 0.02929401397705078 time for calcul the mask position with numpy : 0.03606748580932617 nb_pixel_total : 21826 time to create 1 rle with old method : 0.022913694381713867 time for calcul the mask position with numpy : 0.03968095779418945 nb_pixel_total : 15640 time to create 1 rle with old method : 0.01717400550842285 time for calcul the mask position with numpy : 0.03498482704162598 nb_pixel_total : 27454 time to create 1 rle with old method : 0.028045654296875 time for calcul the mask position with numpy : 0.023142099380493164 nb_pixel_total : 53585 time to create 1 rle with old method : 0.05594682693481445 time for calcul the mask position with numpy : 0.024834156036376953 nb_pixel_total : 55806 time to create 1 rle with old method : 0.05997443199157715 create new chi : 2.1215529441833496 time to delete rle : 0.000997304916381836 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 6850 TO DO : save crop sub photo not yet done ! save time : 0.4441103935241699 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 1.7127771377563477 time for calcul the mask position with numpy : 0.5331387519836426 nb_pixel_total : 8119067 time to create 1 rle with new method : 0.6099622249603271 time for calcul the mask position with numpy : 0.023581266403198242 nb_pixel_total : 14064 time to create 1 rle with old method : 0.015456438064575195 time for calcul the mask position with numpy : 0.02443861961364746 nb_pixel_total : 99312 time to create 1 rle with old method : 0.1048271656036377 time for calcul the mask position with numpy : 0.024790525436401367 nb_pixel_total : 26178 time to create 1 rle with old method : 0.02808237075805664 time for calcul the mask position with numpy : 0.026168346405029297 nb_pixel_total : 35779 time to create 1 rle with old method : 0.0383296012878418 create new chi : 1.470752239227295 time to delete rle : 0.0007448196411132812 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 4308 TO DO : save crop sub photo not yet done ! save time : 0.27785396575927734 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.2243850231170654 time for calcul the mask position with numpy : 0.589097261428833 nb_pixel_total : 7983618 time to create 1 rle with new method : 0.6968696117401123 time for calcul the mask position with numpy : 0.04046034812927246 nb_pixel_total : 47988 time to create 1 rle with old method : 0.05118608474731445 time for calcul the mask position with numpy : 0.023763179779052734 nb_pixel_total : 44164 time to create 1 rle with old method : 0.046735286712646484 time for calcul the mask position with numpy : 0.024385690689086914 nb_pixel_total : 70982 time to create 1 rle with old method : 0.07641863822937012 time for calcul the mask position with numpy : 0.024512052536010742 nb_pixel_total : 10945 time to create 1 rle with old method : 0.011824369430541992 time for calcul the mask position with numpy : 0.0244140625 nb_pixel_total : 89576 time to create 1 rle with old method : 0.09750223159790039 time for calcul the mask position with numpy : 0.024744749069213867 nb_pixel_total : 47127 time to create 1 rle with old method : 0.05094313621520996 create new chi : 1.8254046440124512 time to delete rle : 0.0008881092071533203 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5546 TO DO : save crop sub photo not yet done ! save time : 0.37421679496765137 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 3.417694330215454 time for calcul the mask position with numpy : 0.48027849197387695 nb_pixel_total : 8106626 time to create 1 rle with new method : 1.005821943283081 time for calcul the mask position with numpy : 0.02411794662475586 nb_pixel_total : 11774 time to create 1 rle with old method : 0.012815237045288086 time for calcul the mask position with numpy : 0.02334451675415039 nb_pixel_total : 10985 time to create 1 rle with old method : 0.011991024017333984 time for calcul the mask position with numpy : 0.02353835105895996 nb_pixel_total : 21641 time to create 1 rle with old method : 0.023235082626342773 time for calcul the mask position with numpy : 0.023363113403320312 nb_pixel_total : 13452 time to create 1 rle with old method : 0.014944076538085938 time for calcul the mask position with numpy : 0.024274349212646484 nb_pixel_total : 32339 time to create 1 rle with old method : 0.035410404205322266 time for calcul the mask position with numpy : 0.024811267852783203 nb_pixel_total : 3477 time to create 1 rle with old method : 0.0037479400634765625 time for calcul the mask position with numpy : 0.024938583374023438 nb_pixel_total : 17028 time to create 1 rle with old method : 0.018365859985351562 time for calcul the mask position with numpy : 0.024303436279296875 nb_pixel_total : 21725 time to create 1 rle with old method : 0.023355960845947266 time for calcul the mask position with numpy : 0.024516820907592773 nb_pixel_total : 14391 time to create 1 rle with old method : 0.015271902084350586 time for calcul the mask position with numpy : 0.023483991622924805 nb_pixel_total : 40962 time to create 1 rle with old method : 0.04295063018798828 create new chi : 1.9721107482910156 time to delete rle : 0.0008382797241210938 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 5425 TO DO : save crop sub photo not yet done ! save time : 0.3169252872467041 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.162081480026245 time for calcul the mask position with numpy : 0.4809579849243164 nb_pixel_total : 8052162 time to create 1 rle with new method : 0.6394753456115723 time for calcul the mask position with numpy : 0.022808074951171875 nb_pixel_total : 11066 time to create 1 rle with old method : 0.011495113372802734 time for calcul the mask position with numpy : 0.023568391799926758 nb_pixel_total : 15028 time to create 1 rle with old method : 0.016098976135253906 time for calcul the mask position with numpy : 0.024151325225830078 nb_pixel_total : 22194 time to create 1 rle with old method : 0.0234525203704834 time for calcul the mask position with numpy : 0.024303436279296875 nb_pixel_total : 44517 time to create 1 rle with old method : 0.04946088790893555 time for calcul the mask position with numpy : 0.024417400360107422 nb_pixel_total : 65371 time to create 1 rle with old method : 0.07074213027954102 time for calcul the mask position with numpy : 0.02413177490234375 nb_pixel_total : 84062 time to create 1 rle with old method : 0.08880352973937988 create new chi : 1.5655596256256104 time to delete rle : 0.0007188320159912109 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4700 TO DO : save crop sub photo not yet done ! save time : 0.27614450454711914 map_output_result : {1390139683: (0.0, 'Should be the crop_list due to order', 0), 1390139682: (0.0, 'Should be the crop_list due to order', 0), 1390139681: (0.0, 'Should be the crop_list due to order', 0), 1390139680: (0.0, 'Should be the crop_list due to order', 0), 1390139679: (0.0, 'Should be the crop_list due to order', 0), 1390139678: (0.0, 'Should be the crop_list due to order', 0), 1390139676: (0.0, 'Should be the crop_list due to order', 0), 1390139675: (0.0, 'Should be the crop_list due to order', 0), 1390139674: (0.0, 'Should be the crop_list due to order', 0), 1390139672: (0.0, 'Should be the crop_list due to order', 0), 1390139671: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1390139683, 1390139682, 1390139681, 1390139680, 1390139679, 1390139678, 1390139676, 1390139675, 1390139674, 1390139672, 1390139671] Looping around the photos to save general results len do output : 11 /1390139683.Didn't retrieve data . /1390139682.Didn't retrieve data . /1390139681.Didn't retrieve data . /1390139680.Didn't retrieve data . /1390139679.Didn't retrieve data . /1390139678.Didn't retrieve data . /1390139676.Didn't retrieve data . /1390139675.Didn't retrieve data . /1390139674.Didn't retrieve data . /1390139672.Didn't retrieve data . /1390139671.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139683', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139682', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139681', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139680', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139679', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139678', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139676', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139675', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139674', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139672', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139671', None, None, None, None, None, '3971899') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.010496139526367188 save_final save missing photos in datou_result : time spend for datou_step_exec : 56.94090557098389 time spend to save output : 0.01098775863647461 total time spend for step 3 : 56.95189332962036 step4:ventilate_hashtags_in_portfolio Fri Oct 31 09:23:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28008658 get user id for portfolio 28008658 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008658 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','autre','carton','pet_clair','metal','environnement','flou','mal_croppe','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008658 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','autre','carton','pet_clair','metal','environnement','flou','mal_croppe','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008658 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','autre','carton','pet_clair','metal','environnement','flou','mal_croppe','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28009912,28009913,28009914,28009915,28009916,28009917,28009918,28009919,28009920,28009921,28009922?tags=papier,pehd,pet_fonce,autre,carton,pet_clair,metal,environnement,flou,mal_croppe,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1390139683, 1390139682, 1390139681, 1390139680, 1390139679, 1390139678, 1390139676, 1390139675, 1390139674, 1390139672, 1390139671] Looping around the photos to save general results len do output : 1 /28008658. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139683', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139682', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139681', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139680', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139679', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139678', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139676', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139675', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139674', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139672', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139671', None, None, None, None, None, '3971899') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012349367141723633 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5953855514526367 time spend to save output : 0.012597799301147461 total time spend for step 4 : 1.6079833507537842 step5:final Fri Oct 31 09:23:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1390139683: ('0.03534976501122333',), 1390139682: ('0.03534976501122333',), 1390139681: ('0.03534976501122333',), 1390139680: ('0.03534976501122333',), 1390139679: ('0.03534976501122333',), 1390139678: ('0.03534976501122333',), 1390139676: ('0.03534976501122333',), 1390139675: ('0.03534976501122333',), 1390139674: ('0.03534976501122333',), 1390139672: ('0.03534976501122333',), 1390139671: ('0.03534976501122333',)} new output for save of step final : {1390139683: ('0.03534976501122333',), 1390139682: ('0.03534976501122333',), 1390139681: ('0.03534976501122333',), 1390139680: ('0.03534976501122333',), 1390139679: ('0.03534976501122333',), 1390139678: ('0.03534976501122333',), 1390139676: ('0.03534976501122333',), 1390139675: ('0.03534976501122333',), 1390139674: ('0.03534976501122333',), 1390139672: ('0.03534976501122333',), 1390139671: ('0.03534976501122333',)} [1390139683, 1390139682, 1390139681, 1390139680, 1390139679, 1390139678, 1390139676, 1390139675, 1390139674, 1390139672, 1390139671] Looping around the photos to save general results len do output : 11 /1390139683.Didn't retrieve data . /1390139682.Didn't retrieve data . /1390139681.Didn't retrieve data . /1390139680.Didn't retrieve data . /1390139679.Didn't retrieve data . /1390139678.Didn't retrieve data . /1390139676.Didn't retrieve data . /1390139675.Didn't retrieve data . /1390139674.Didn't retrieve data . /1390139672.Didn't retrieve data . /1390139671.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139683', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139682', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139681', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139680', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139679', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139678', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139676', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139675', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139674', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139672', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139671', None, None, None, None, None, '3971899') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01110982894897461 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12150406837463379 time spend to save output : 0.01163935661315918 total time spend for step 5 : 0.13314342498779297 step6:blur_detection Fri Oct 31 09:23:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090.jpg resize: (2160, 3840) 1390139683 -7.098546220755501 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716.jpg resize: (2160, 3840) 1390139682 -6.632085681011091 treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462.jpg resize: (2160, 3840) 1390139681 -7.0245919824948455 treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351.jpg resize: (2160, 3840) 1390139680 -7.1688560479274335 treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603.jpg resize: (2160, 3840) 1390139679 -4.517804668786896 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066.jpg resize: (2160, 3840) 1390139678 -7.123595683925652 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931.jpg resize: (2160, 3840) 1390139676 -7.144620696984534 treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688.jpg resize: (2160, 3840) 1390139675 -7.09855686988898 treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416.jpg resize: (2160, 3840) 1390139674 -7.180367976032119 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988.jpg resize: (2160, 3840) 1390139672 -4.114825884107797 treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124.jpg resize: (2160, 3840) 1390139671 -6.30226270390584 treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938030_0.png resize: (207, 158) 1391056644 -3.163592126417722 treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938031_0.png resize: (297, 223) 1391056645 -4.044151445578671 treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938032_0.png resize: (237, 605) 1391056646 -4.90389274057841 treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938034_0.png resize: (170, 211) 1391056647 -5.115199029473271 treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938035_0.png resize: (120, 154) 1391056649 -3.8150378063500168 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938039_0.png resize: (101, 95) 1391056650 -2.629577699132856 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938042_0.png resize: (194, 230) 1391056651 -4.105863601310086 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938043_0.png resize: (291, 307) 1391056652 -5.61793609742785 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938044_0.png resize: (171, 138) 1391056654 -4.765425824253715 treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938047_0.png resize: (245, 159) 1391056655 -4.038260291206025 treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938052_0.png resize: (127, 188) 1391056656 -4.18408136670301 treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938053_0.png resize: (236, 275) 1391056657 -4.79727392391402 treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938054_0.png resize: (125, 175) 1391056659 -3.1383045176500994 treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938055_0.png resize: (193, 96) 1391056660 -3.0001615379818944 treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938059_0.png resize: (274, 191) 1391056661 -4.578345659323132 treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938060_0.png resize: (72, 208) 1391056662 -4.284552564904014 treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938064_0.png resize: (208, 277) 1391056664 -4.545207381567088 treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938065_0.png resize: (88, 126) 1391056665 -1.5347855745537586 treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938066_0.png resize: (122, 131) 1391056666 -2.9663326478954506 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938067_0.png resize: (127, 249) 1391056667 -4.376111709103345 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938068_0.png resize: (130, 113) 1391056669 -2.3922345709480517 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938069_0.png resize: (236, 236) 1391056670 -0.8806539251293536 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938070_0.png resize: (166, 135) 1391056671 -4.311952793612013 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938071_0.png resize: (132, 174) 1391056672 -2.877159120648171 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938073_0.png resize: (276, 230) 1391056674 -3.5930756658606677 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938074_0.png resize: (654, 561) 1391056675 -5.267778220050058 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938076_0.png resize: (170, 160) 1391056676 -4.467034740026387 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938078_0.png resize: (320, 339) 1391056677 -3.9272255227833788 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938079_0.png resize: (302, 321) 1391056679 -3.2509170118892587 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938080_0.png resize: (180, 240) 1391056681 -4.148262839003626 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938081_0.png resize: (123, 174) 1391056682 -4.649954204198796 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938082_0.png resize: (208, 125) 1391056683 -3.3306737257640986 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938083_0.png resize: (183, 204) 1391056685 -4.395742719369048 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938084_0.png resize: (293, 555) 1391056687 -5.339486241992053 treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938087_0.png resize: (204, 258) 1391056688 -3.8391258003311406 treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938089_0.png resize: (368, 485) 1391056689 -4.301254053401594 treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938092_0.png resize: (376, 377) 1391056691 -2.500386008488601 treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938093_0.png resize: (100, 157) 1391056693 -4.756437651324508 treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938094_0.png resize: (336, 405) 1391056694 -4.771000775344488 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938098_0.png resize: (163, 153) 1391056695 -4.369713723896565 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938101_0.png resize: (54, 99) 1391056697 -4.683020976980818 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938103_0.png resize: (155, 144) 1391056699 -3.2649204258734508 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938104_0.png resize: (209, 151) 1391056700 -5.18426143691701 treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938107_0.png resize: (315, 338) 1391056701 -4.642681319862217 treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938109_0.png resize: (229, 332) 1391056702 -3.7683178105757373 treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938111_0.png resize: (120, 169) 1391056705 -4.687213876028263 treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938112_0.png resize: (141, 137) 1391056706 -4.170451245259333 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938036_0.png resize: (179, 168) 1391056764 -4.857938869448297 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938040_0.png resize: (167, 199) 1391056765 -3.704884383727739 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938041_0.png resize: (160, 191) 1391056766 -2.8724659260440037 treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938049_0.png resize: (147, 184) 1391056768 -2.8826662720948764 treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938056_0.png resize: (150, 141) 1391056769 -2.594694871252978 treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938061_0.png resize: (186, 348) 1391056770 -3.9498411343384228 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938086_0.png resize: (217, 234) 1391056771 -4.839523764999515 treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938088_0.png resize: (176, 205) 1391056773 -3.006124831837236 treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938095_0.png resize: (258, 243) 1391056774 -4.404183422485567 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938097_0.png resize: (219, 330) 1391056776 -4.228708941880966 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938102_0.png resize: (224, 264) 1391056777 -4.0179621553905 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938038_0.png resize: (122, 175) 1391056815 -4.354264897314708 treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938058_0.png resize: (173, 142) 1391056816 -5.217106092134606 treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938063_0.png resize: (120, 134) 1391056819 -4.773934173939177 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938099_0.png resize: (199, 158) 1391056820 -5.232526493915083 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938100_0.png resize: (141, 153) 1391056821 -4.4561086465781115 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938105_0.png resize: (88, 162) 1391056823 -4.514504097448552 treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938106_0.png resize: (124, 118) 1391056825 -4.128485267579913 treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938110_0.png resize: (169, 182) 1391056826 -4.539285873577785 treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938033_0.png resize: (488, 152) 1391056949 -4.79435234409397 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938037_0.png resize: (404, 315) 1391056950 -4.850795442976833 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938045_0.png resize: (166, 477) 1391056951 -4.525407447827088 treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938046_0.png resize: (407, 458) 1391056952 -4.588067439901585 treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938048_0.png resize: (214, 527) 1391056954 -3.88882836764018 treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938050_0.png resize: (164, 268) 1391056955 -2.993210933991702 treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938051_0.png resize: (284, 549) 1391056956 -5.537308559415178 treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938057_0.png resize: (336, 247) 1391056957 -5.488634302787549 treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938062_0.png resize: (284, 411) 1391056959 -4.9594354207152795 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938072_0.png resize: (264, 188) 1391056960 -4.985289988700198 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938075_0.png resize: (236, 217) 1391056961 -4.377980989619837 treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938108_0.png resize: (278, 323) 1391056962 -5.300492459322329 treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938090_0.png resize: (168, 463) 1391057000 -2.538316593194599 treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938077_0.png resize: (339, 250) 1391057032 -4.160472358835614 treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938085_0.png resize: (272, 313) 1391057033 -5.971900187884077 treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938091_0.png resize: (242, 234) 1391057034 -6.08115909684609 treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938096_0.png resize: (367, 256) 1391057035 -5.585772462738344 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 94 time used for this insertion : 0.012239933013916016 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 94 time used for this insertion : 0.013229608535766602 save missing photos in datou_result : time spend for datou_step_exec : 43.40926694869995 time spend to save output : 0.030292034149169922 total time spend for step 6 : 43.43955898284912 step7:brightness Fri Oct 31 09:23:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090.jpg treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716.jpg treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462.jpg treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351.jpg treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603.jpg treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066.jpg treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931.jpg treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688.jpg treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416.jpg treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988.jpg treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124.jpg treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938030_0.png treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938031_0.png treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938032_0.png treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938034_0.png treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938035_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938039_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938042_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938043_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938044_0.png treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938047_0.png treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938052_0.png treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938053_0.png treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938054_0.png treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938055_0.png treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938059_0.png treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938060_0.png treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938064_0.png treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938065_0.png treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938066_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938067_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938068_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938069_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938070_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938071_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938073_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938074_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938076_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938078_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938079_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938080_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938081_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938082_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938083_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938084_0.png treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938087_0.png treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938089_0.png treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938092_0.png treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938093_0.png treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938094_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938098_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938101_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938103_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938104_0.png treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938107_0.png treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938109_0.png treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938111_0.png treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938112_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938036_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938040_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938041_0.png treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938049_0.png treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938056_0.png treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938061_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938086_0.png treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938088_0.png treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938095_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938097_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938102_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938038_0.png treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938058_0.png treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938063_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938099_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938100_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938105_0.png treat image : temp/1761898827_827446_1390139672_bc94aef639ae13c5039217666b2ba7b5_98772988_rle_crop_4008938106_0.png treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938110_0.png treat image : temp/1761898827_827446_1390139683_b08dc249a10a4775f6b361c748d4cfb1_5023090_rle_crop_4008938033_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938037_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938045_0.png treat image : temp/1761898827_827446_1390139682_7410a98409eb9aa0e8ab013a229951b9_56828716_rle_crop_4008938046_0.png treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938048_0.png treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938050_0.png treat image : temp/1761898827_827446_1390139681_51de7f418adaa02b4fbcbd77eeca034a_97932462_rle_crop_4008938051_0.png treat image : temp/1761898827_827446_1390139680_ec2e4e1a3b52584d215389eca1cd849a_18586351_rle_crop_4008938057_0.png treat image : temp/1761898827_827446_1390139679_a13564940895e982d6491259d660cbaa_80384603_rle_crop_4008938062_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938072_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938075_0.png treat image : temp/1761898827_827446_1390139671_e726e52a34eb1d88ea0433567d3e6afa_88778124_rle_crop_4008938108_0.png treat image : temp/1761898827_827446_1390139675_41e2607d2f8e28cb416d9654b2055204_55153688_rle_crop_4008938090_0.png treat image : temp/1761898827_827446_1390139678_00902f9b17d0ef6a34b974c39153089b_5647066_rle_crop_4008938077_0.png treat image : temp/1761898827_827446_1390139676_5a244aec211f963fe45964157587f075_45166931_rle_crop_4008938085_0.png treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938091_0.png treat image : temp/1761898827_827446_1390139674_5bc3adb44e3837042fbf487194f7f72c_62626416_rle_crop_4008938096_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 94 time used for this insertion : 0.01350712776184082 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 94 time used for this insertion : 0.014744281768798828 save missing photos in datou_result : time spend for datou_step_exec : 11.719890832901001 time spend to save output : 0.033406972885131836 total time spend for step 7 : 11.753297805786133 step8:velours_tree Fri Oct 31 09:24:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13105177879333496 time spend to save output : 5.1975250244140625e-05 total time spend for step 8 : 0.1311037540435791 step9:send_mail_cod Fri Oct 31 09:24:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28008658_31-10-2025_09_24_10.pdf 28009912 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280099121761899050 28009913 imagette280099131761899052 28009914 change filename to text .change filename to text .change filename to text .change filename to text .imagette280099141761899052 28009915 change filename to text .imagette280099151761899053 28009916 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280099161761899053 28009917 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280099171761899054 28009918 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280099181761899055 28009920 imagette280099201761899056 28009921 imagette280099211761899056 28009922 imagette280099221761899056 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28008658 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28009912,28009913,28009914,28009915,28009916,28009917,28009918,28009919,28009920,28009921,28009922?tags=papier,pehd,pet_fonce,autre,carton,pet_clair,metal,environnement,flou,mal_croppe,background args[1390139683] : ((1390139683, -7.098546220755501, 492609224), (1390139683, 0.1454341270425324, 2107752395), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139682] : ((1390139682, -6.632085681011091, 492609224), (1390139682, -0.05842590444466982, 2107752395), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139681] : ((1390139681, -7.0245919824948455, 492609224), (1390139681, 0.13869073648386648, 2107752395), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139680] : ((1390139680, -7.1688560479274335, 492609224), (1390139680, 0.1870936600964941, 2107752395), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139679] : ((1390139679, -4.517804668786896, 492609224), (1390139679, -0.9176714904081797, 501862349), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139678] : ((1390139678, -7.123595683925652, 492609224), (1390139678, 0.23352938493505435, 2107752395), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139676] : ((1390139676, -7.144620696984534, 492609224), (1390139676, 0.07528455685613396, 2107752395), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139675] : ((1390139675, -7.09855686988898, 492609224), (1390139675, 0.08559005505027782, 2107752395), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139674] : ((1390139674, -7.180367976032119, 492609224), (1390139674, 0.07788724748101496, 2107752395), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139672] : ((1390139672, -4.114825884107797, 492609224), (1390139672, -2.0579893705865335, 501862349), '0.03534976501122333') We are sending mail with results at report@fotonower.com args[1390139671] : ((1390139671, -6.30226270390584, 492609224), (1390139671, -0.4402346297221475, 496442774), '0.03534976501122333') We are sending mail with results at report@fotonower.com refus_total : 0.03534976501122333 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28008658 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008658_31-10-2025_09_24_10.pdf results_Auto_P28008658_31-10-2025_09_24_10.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008658_31-10-2025_09_24_10.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28008658','results_Auto_P28008658_31-10-2025_09_24_10.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008658_31-10-2025_09_24_10.pdf','pdf','','0.67','0.03534976501122333') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28008658

https://www.fotonower.com/image?json=false&list_photos_id=1390139683
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139682
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139681
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139680
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139679
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139678
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139676
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139675
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139674
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390139672
La photo est trop sombre, merci de reprendre une photo.(avec le score = -2.0579893705865335,le score doit entre -2 et 2)
https://www.fotonower.com/image?json=false&list_photos_id=1390139671
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 3.53%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28009912?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28009914?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28009915?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28009916?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28009917?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28009918?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008658_31-10-2025_09_24_10.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28009912,28009913,28009914,28009915,28009916,28009917,28009918,28009919,28009920,28009921,28009922?tags=papier,pehd,pet_fonce,autre,carton,pet_clair,metal,environnement,flou,mal_croppe,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 31 Oct 2025 08:24:19 GMT Content-Length: 0 Connection: close X-Message-Id: mYn5Q5ntS6CPduYiTLD3Lg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1390139683, 1390139682, 1390139681, 1390139680, 1390139679, 1390139678, 1390139676, 1390139675, 1390139674, 1390139672, 1390139671] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139683', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139682', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139681', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139680', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139679', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139678', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139676', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139675', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139674', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139672', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139671', None, None, None, None, None, '3971899') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.010894060134887695 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.227220058441162 time spend to save output : 0.011136054992675781 total time spend for step 9 : 8.238356113433838 step10:split_time_score Fri Oct 31 09:24:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 23102025 28008658 Nombre de photos uploadées : 11 / 23040 (0%) 23102025 28008658 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 23102025 28008658 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005435943603515625 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21593666076660156 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008154 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008200 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008246 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008290 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008334 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008473 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008504 order by id desc limit 1 Qualite : 0.015526504498986078 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008512_31-10-2025_09_23_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008512 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008512 AND mptpi.`type`=3726 To do Qualite : 0.017347448653557977 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008634_31-10-2025_09_07_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008634 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008634 AND mptpi.`type`=3726 To do Qualite : 0.028557345527743153 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008640_31-10-2025_09_18_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008640 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008640 AND mptpi.`type`=3726 To do Qualite : 0.03534976501122333 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008658_31-10-2025_09_24_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008658 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008658 AND mptpi.`type`=3594 To do Qualite : 0.03207469661896745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008685_31-10-2025_09_14_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008685 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008685 AND mptpi.`type`=3594 To do Qualite : 0.08704102049769485 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008705_31-10-2025_09_12_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008705 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008705 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'23102025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1390139683, 1390139682, 1390139681, 1390139680, 1390139679, 1390139678, 1390139676, 1390139675, 1390139674, 1390139672, 1390139671] Looping around the photos to save general results len do output : 1 /28008658Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139683', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139682', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139681', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139680', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139679', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139678', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139676', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139675', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139674', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139672', None, None, None, None, None, '3971899') ('3318', None, None, None, None, None, None, None, '3971899') ('3318', '28008658', '1390139671', None, None, None, None, None, '3971899') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.010470151901245117 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.762735843658447 time spend to save output : 0.010715007781982422 total time spend for step 10 : 11.77345085144043 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 112.25user 88.77system 4:06.03elapsed 81%CPU (0avgtext+0avgdata 4731640maxresident)k 661136inputs+94184outputs (3352major+11259651minor)pagefaults 0swaps