python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3054074 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3885195'] with mtr_portfolio_ids : ['27592231'] and first list_photo_ids : [] new path : /proc/3054074/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 28 ; length of list_pids : 28 ; length of list_args : 28 time to download the photos : 3.745529890060425 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Oct 8 12:10:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4389 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-08 12:10:37.274106: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-08 12:10:37.308635: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-10-08 12:10:37.311504: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6b60000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-08 12:10:37.311556: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-08 12:10:37.317158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-08 12:10:37.510584: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1bbcecd0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-08 12:10:37.510631: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-08 12:10:37.512071: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-08 12:10:37.512820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-08 12:10:37.529723: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-08 12:10:37.552588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-08 12:10:37.555506: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-08 12:10:37.594017: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-08 12:10:37.600061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-08 12:10:37.666350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-08 12:10:37.668161: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-08 12:10:37.668679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-08 12:10:37.669671: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-08 12:10:37.669698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-08 12:10:37.669713: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-08 12:10:37.671679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3937 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-08 12:10:38.190493: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-08 12:10:38.190614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-08 12:10:38.190648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-08 12:10:38.190679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-08 12:10:38.190709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-08 12:10:38.190739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-08 12:10:38.190769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-08 12:10:38.190799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-08 12:10:38.192399: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-08 12:10:38.193980: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-08 12:10:38.194051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-08 12:10:38.194081: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-08 12:10:38.194109: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-08 12:10:38.194136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-08 12:10:38.194166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-08 12:10:38.194193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-08 12:10:38.194224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-08 12:10:38.195853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-08 12:10:38.195894: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-08 12:10:38.195910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-08 12:10:38.195924: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-08 12:10:38.197622: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3937 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-08 12:10:47.573683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-08 12:10:48.190197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-08 12:10:51.647547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:51.741700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.01G (3233710080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:51.742758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.71G (2910339072 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:51.743800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.44G (2619305216 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.587449: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-10-08 12:10:52.643263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.643352: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.644519: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.644548: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.652442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.652487: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.653129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.653146: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.659623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.659669: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.660260: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.660277: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.740637: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.740705: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.741296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.741312: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.749302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.749327: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.749919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.749934: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-08 12:10:52.803645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.804620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.805432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.806201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.811434: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.812027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.812639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.813287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.814850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.814869: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-08 12:10:52.825179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.825798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.838051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.838680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.839277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.839861: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.840464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-08 12:10:52.841051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.35G (3593011200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 28 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 51.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 3054448 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2003 tf kernel not reseted sub process len(results) : 28 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 28 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3196 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006313323974609375 nb_pixel_total : 17997 time to create 1 rle with old method : 0.02265310287475586 length of segment : 155 time for calcul the mask position with numpy : 0.00021648406982421875 nb_pixel_total : 8136 time to create 1 rle with old method : 0.009982109069824219 length of segment : 118 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 5720 time to create 1 rle with old method : 0.006849050521850586 length of segment : 111 time for calcul the mask position with numpy : 0.00018548965454101562 nb_pixel_total : 7374 time to create 1 rle with old method : 0.00890040397644043 length of segment : 106 time for calcul the mask position with numpy : 0.0001785755157470703 nb_pixel_total : 8917 time to create 1 rle with old method : 0.010592937469482422 length of segment : 147 time for calcul the mask position with numpy : 0.00012755393981933594 nb_pixel_total : 6169 time to create 1 rle with old method : 0.007308244705200195 length of segment : 121 time for calcul the mask position with numpy : 0.0008168220520019531 nb_pixel_total : 39610 time to create 1 rle with old method : 0.047562360763549805 length of segment : 237 time for calcul the mask position with numpy : 0.00011944770812988281 nb_pixel_total : 5190 time to create 1 rle with old method : 0.005833148956298828 length of segment : 90 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 6083 time to create 1 rle with old method : 0.006862163543701172 length of segment : 83 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 6830 time to create 1 rle with old method : 0.007784128189086914 length of segment : 92 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 3051 time to create 1 rle with old method : 0.0037724971771240234 length of segment : 59 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 2996 time to create 1 rle with old method : 0.003596782684326172 length of segment : 78 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 2520 time to create 1 rle with old method : 0.003095865249633789 length of segment : 55 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 2903 time to create 1 rle with old method : 0.0037529468536376953 length of segment : 65 time for calcul the mask position with numpy : 0.002179861068725586 nb_pixel_total : 112657 time to create 1 rle with old method : 0.13330841064453125 length of segment : 519 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 8354 time to create 1 rle with old method : 0.009847402572631836 length of segment : 97 time for calcul the mask position with numpy : 0.0002148151397705078 nb_pixel_total : 9523 time to create 1 rle with old method : 0.011118412017822266 length of segment : 133 time for calcul the mask position with numpy : 0.00016069412231445312 nb_pixel_total : 5723 time to create 1 rle with old method : 0.006860017776489258 length of segment : 109 time for calcul the mask position with numpy : 0.0004363059997558594 nb_pixel_total : 23189 time to create 1 rle with old method : 0.02735447883605957 length of segment : 248 time for calcul the mask position with numpy : 0.00021219253540039062 nb_pixel_total : 6319 time to create 1 rle with old method : 0.007750272750854492 length of segment : 154 time for calcul the mask position with numpy : 0.0001690387725830078 nb_pixel_total : 9725 time to create 1 rle with old method : 0.011224031448364258 length of segment : 112 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 13362 time to create 1 rle with old method : 0.015599727630615234 length of segment : 128 time for calcul the mask position with numpy : 0.00019669532775878906 nb_pixel_total : 8481 time to create 1 rle with old method : 0.010459661483764648 length of segment : 92 time for calcul the mask position with numpy : 0.00016760826110839844 nb_pixel_total : 5456 time to create 1 rle with old method : 0.006386518478393555 length of segment : 122 time for calcul the mask position with numpy : 0.015908002853393555 nb_pixel_total : 669338 time to create 1 rle with new method : 0.18413591384887695 length of segment : 982 time for calcul the mask position with numpy : 0.00021767616271972656 nb_pixel_total : 4507 time to create 1 rle with old method : 0.005535602569580078 length of segment : 95 time for calcul the mask position with numpy : 0.00029730796813964844 nb_pixel_total : 5416 time to create 1 rle with old method : 0.00679469108581543 length of segment : 142 time for calcul the mask position with numpy : 0.00033545494079589844 nb_pixel_total : 5488 time to create 1 rle with old method : 0.007108926773071289 length of segment : 148 time for calcul the mask position with numpy : 0.0004086494445800781 nb_pixel_total : 10161 time to create 1 rle with old method : 0.012658119201660156 length of segment : 127 time for calcul the mask position with numpy : 0.00023221969604492188 nb_pixel_total : 5579 time to create 1 rle with old method : 0.007012128829956055 length of segment : 62 time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 3121 time to create 1 rle with old method : 0.003922700881958008 length of segment : 102 time for calcul the mask position with numpy : 0.0002918243408203125 nb_pixel_total : 5328 time to create 1 rle with old method : 0.006474971771240234 length of segment : 141 time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 5805 time to create 1 rle with old method : 0.007241725921630859 length of segment : 110 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 3302 time to create 1 rle with old method : 0.004175424575805664 length of segment : 72 time for calcul the mask position with numpy : 0.00045943260192871094 nb_pixel_total : 6549 time to create 1 rle with old method : 0.009926795959472656 length of segment : 150 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 7574 time to create 1 rle with old method : 0.009138822555541992 length of segment : 98 time for calcul the mask position with numpy : 0.0007841587066650391 nb_pixel_total : 29463 time to create 1 rle with old method : 0.035064697265625 length of segment : 170 time for calcul the mask position with numpy : 0.002359628677368164 nb_pixel_total : 89695 time to create 1 rle with old method : 0.10494446754455566 length of segment : 498 time for calcul the mask position with numpy : 0.0023376941680908203 nb_pixel_total : 115985 time to create 1 rle with old method : 0.13712477684020996 length of segment : 505 time for calcul the mask position with numpy : 0.00017690658569335938 nb_pixel_total : 2159 time to create 1 rle with old method : 0.002694368362426758 length of segment : 59 time for calcul the mask position with numpy : 0.0003428459167480469 nb_pixel_total : 5943 time to create 1 rle with old method : 0.007525920867919922 length of segment : 105 time for calcul the mask position with numpy : 0.025014877319335938 nb_pixel_total : 1411990 time to create 1 rle with new method : 0.5622589588165283 length of segment : 1549 time for calcul the mask position with numpy : 0.0002694129943847656 nb_pixel_total : 7328 time to create 1 rle with old method : 0.010361909866333008 length of segment : 82 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 6204 time to create 1 rle with old method : 0.007669210433959961 length of segment : 83 time for calcul the mask position with numpy : 0.0021724700927734375 nb_pixel_total : 103946 time to create 1 rle with old method : 0.12120199203491211 length of segment : 509 time for calcul the mask position with numpy : 0.0008542537689208984 nb_pixel_total : 32249 time to create 1 rle with old method : 0.038347482681274414 length of segment : 253 time for calcul the mask position with numpy : 0.00015664100646972656 nb_pixel_total : 3093 time to create 1 rle with old method : 0.0038213729858398438 length of segment : 66 time for calcul the mask position with numpy : 0.0002987384796142578 nb_pixel_total : 6280 time to create 1 rle with old method : 0.00756072998046875 length of segment : 153 time for calcul the mask position with numpy : 0.0003459453582763672 nb_pixel_total : 10927 time to create 1 rle with old method : 0.013677120208740234 length of segment : 100 time for calcul the mask position with numpy : 0.0001742839813232422 nb_pixel_total : 6468 time to create 1 rle with old method : 0.007993459701538086 length of segment : 74 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 5625 time to create 1 rle with old method : 0.006909608840942383 length of segment : 106 time for calcul the mask position with numpy : 0.011761903762817383 nb_pixel_total : 829879 time to create 1 rle with new method : 0.0921025276184082 length of segment : 1076 time for calcul the mask position with numpy : 0.002245664596557617 nb_pixel_total : 98663 time to create 1 rle with old method : 0.11889338493347168 length of segment : 499 time for calcul the mask position with numpy : 0.00032520294189453125 nb_pixel_total : 8842 time to create 1 rle with old method : 0.010811328887939453 length of segment : 104 time for calcul the mask position with numpy : 0.0006847381591796875 nb_pixel_total : 22851 time to create 1 rle with old method : 0.027193784713745117 length of segment : 208 time for calcul the mask position with numpy : 0.0004253387451171875 nb_pixel_total : 12278 time to create 1 rle with old method : 0.01486063003540039 length of segment : 155 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 6124 time to create 1 rle with old method : 0.007479190826416016 length of segment : 93 time for calcul the mask position with numpy : 0.0004048347473144531 nb_pixel_total : 11124 time to create 1 rle with old method : 0.013208627700805664 length of segment : 155 time for calcul the mask position with numpy : 0.0002636909484863281 nb_pixel_total : 9309 time to create 1 rle with old method : 0.01126241683959961 length of segment : 136 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 2785 time to create 1 rle with old method : 0.003457307815551758 length of segment : 58 time for calcul the mask position with numpy : 0.0025398731231689453 nb_pixel_total : 112843 time to create 1 rle with old method : 0.13138198852539062 length of segment : 523 time for calcul the mask position with numpy : 0.000331878662109375 nb_pixel_total : 19897 time to create 1 rle with old method : 0.023638010025024414 length of segment : 173 time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 5881 time to create 1 rle with old method : 0.007087230682373047 length of segment : 89 time for calcul the mask position with numpy : 0.000408172607421875 nb_pixel_total : 10804 time to create 1 rle with old method : 0.012931108474731445 length of segment : 182 time for calcul the mask position with numpy : 0.0023641586303710938 nb_pixel_total : 115781 time to create 1 rle with old method : 0.13853120803833008 length of segment : 544 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 6122 time to create 1 rle with old method : 0.0073735713958740234 length of segment : 133 time for calcul the mask position with numpy : 0.002035856246948242 nb_pixel_total : 95097 time to create 1 rle with old method : 0.11166143417358398 length of segment : 529 time for calcul the mask position with numpy : 0.0001728534698486328 nb_pixel_total : 2870 time to create 1 rle with old method : 0.0036177635192871094 length of segment : 63 time for calcul the mask position with numpy : 0.00025916099548339844 nb_pixel_total : 7889 time to create 1 rle with old method : 0.009743690490722656 length of segment : 81 time for calcul the mask position with numpy : 0.0003447532653808594 nb_pixel_total : 8060 time to create 1 rle with old method : 0.009947538375854492 length of segment : 168 time for calcul the mask position with numpy : 0.000850677490234375 nb_pixel_total : 24296 time to create 1 rle with old method : 0.042227745056152344 length of segment : 232 time for calcul the mask position with numpy : 0.00021028518676757812 nb_pixel_total : 2752 time to create 1 rle with old method : 0.0034182071685791016 length of segment : 88 time for calcul the mask position with numpy : 0.000652313232421875 nb_pixel_total : 25549 time to create 1 rle with old method : 0.03039836883544922 length of segment : 230 time for calcul the mask position with numpy : 0.00014734268188476562 nb_pixel_total : 2034 time to create 1 rle with old method : 0.0025856494903564453 length of segment : 82 time for calcul the mask position with numpy : 0.00024509429931640625 nb_pixel_total : 8547 time to create 1 rle with old method : 0.010188579559326172 length of segment : 127 time for calcul the mask position with numpy : 0.000324249267578125 nb_pixel_total : 6163 time to create 1 rle with old method : 0.0072057247161865234 length of segment : 150 time for calcul the mask position with numpy : 0.00229644775390625 nb_pixel_total : 105733 time to create 1 rle with old method : 0.13095998764038086 length of segment : 508 time for calcul the mask position with numpy : 0.0001995563507080078 nb_pixel_total : 4428 time to create 1 rle with old method : 0.005479335784912109 length of segment : 75 time for calcul the mask position with numpy : 0.00014162063598632812 nb_pixel_total : 2984 time to create 1 rle with old method : 0.0037908554077148438 length of segment : 52 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 6315 time to create 1 rle with old method : 0.00784754753112793 length of segment : 73 time spent for convertir_results : 6.7361273765563965 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 80 chid ids of type : 3594 Number RLEs to save : 16358 save missing photos in datou_result : time spend for datou_step_exec : 50.55445647239685 time spend to save output : 1.867058277130127 total time spend for step 1 : 52.42151474952698 step2:crop_condition Wed Oct 8 12:11:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 28 ! batch 1 Loaded 80 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759918287_3054074 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783270_0.png', 0, 123, 106, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783271_0.png', 0, 89, 147, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783276_0.png', 0, 96, 92, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783275_0.png', 0, 87, 83, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783277_0.png', 0, 80, 59, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783278_0.png', 0, 111, 74, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783280_0.png', 0, 62, 62, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783279_0.png', 0, 55, 55, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783285_0.png', 0, 239, 159, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783283_0.png', 0, 142, 113, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783286_0.png', 0, 123, 128, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783284_0.png', 0, 97, 109, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141589_c339060415463fbe45b424f4dfa98203_rle_crop_3988783287_0.png', 0, 122, 112, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141441_09b91516568d38e9b5c5b39e625cf30d_rle_crop_3988783288_0.png', 0, 143, 128, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783289_0.png', 0, 147, 92, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783290_0.png', 0, 122, 103, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141341_b3d7d9526e4f2a34ec4d765e6666440b_rle_crop_3988783293_0.png', 0, 56, 142, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783297_0.png', 0, 81, 73, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783294_0.png', 0, 69, 148, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783300_0.png', 0, 70, 72, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783298_0.png', 0, 75, 141, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783299_0.png', 0, 97, 110, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783301_0.png', 0, 80, 150, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783307_0.png', 0, 128, 94, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783309_0.png', 0, 123, 82, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783314_0.png', 0, 75, 153, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783316_0.png', 0, 117, 73, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783317_0.png', 0, 94, 106, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783322_0.png', 0, 156, 130, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138103_63697c3675aa50a9ed43cb0fccdee557_rle_crop_3988783332_0.png', 0, 80, 133, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783336_0.png', 0, 98, 168, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783340_0.png', 0, 54, 62, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783342_0.png', 0, 74, 150, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783344_0.png', 0, 81, 75, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918295), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136650_be13b57459b65260ce32588338de033e_rle_crop_3988783346_0.png', 0, 133, 68, 0, 1759918295,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.899537324905396 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759918301_3054074 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783269_0.png', 0, 88, 99, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783267_0.png', 0, 137, 155, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783282_0.png', 0, 94, 97, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783281_0.png', 0, 368, 515, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783292_0.png', 0, 76, 95, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783315_0.png', 0, 177, 98, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783328_0.png', 0, 180, 171, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783338_0.png', 0, 42, 88, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918303), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783335_0.png', 0, 131, 81, 0, 1759918303,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.1835296154022217 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759918305_3054074 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918305), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783296_0.png', 0, 113, 61, 0, 1759918305,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918305), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783302_0.png', 0, 99, 98, 0, 1759918305,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.126159906387329 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3736932 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759918322_3054074 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783268_0.png', 0, 152, 104, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783273_0.png', 0, 211, 231, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783272_0.png', 0, 62, 121, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783274_0.png', 0, 74, 90, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783291_0.png', 0, 952, 977, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783295_0.png', 0, 114, 127, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783303_0.png', 0, 266, 165, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783304_0.png', 0, 315, 496, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783308_0.png', 0, 1728, 955, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783305_0.png', 0, 352, 504, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783311_0.png', 0, 333, 507, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139131_251393d06285aa9a3d75c9f33ee2c276_rle_crop_3988783312_0.png', 0, 263, 252, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138435_69d2778d910bc1db89a7b8f915b12fa5_rle_crop_3988783318_0.png', 0, 1181, 980, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783321_0.png', 0, 178, 200, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783320_0.png', 0, 101, 104, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783319_0.png', 0, 317, 498, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783325_0.png', 0, 112, 134, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783324_0.png', 0, 99, 155, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783326_0.png', 0, 60, 57, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783327_0.png', 0, 340, 520, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138106_dd0b24306c25b2438e9425e84a025f73_rle_crop_3988783331_0.png', 0, 372, 537, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138106_dd0b24306c25b2438e9425e84a025f73_rle_crop_3988783330_0.png', 0, 107, 182, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783337_0.png', 0, 127, 232, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783333_0.png', 0, 295, 494, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783339_0.png', 0, 175, 208, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783343_0.png', 0, 368, 508, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918328), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136650_be13b57459b65260ce32588338de033e_rle_crop_3988783345_0.png', 0, 71, 52, 0, 1759918328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 27 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.309790134429932 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759918333_3054074 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918334), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783306_0.png', 0, 50, 59, 0, 1759918334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918334), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783310_0.png', 0, 96, 83, 0, 1759918334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918334), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388139131_251393d06285aa9a3d75c9f33ee2c276_rle_crop_3988783313_0.png', 0, 63, 66, 0, 1759918334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918334), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783323_0.png', 0, 87, 93, 0, 1759918334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918334), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783329_0.png', 0, 83, 89, 0, 1759918334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918334), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783334_0.png', 0, 62, 63, 0, 1759918334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759918334), 0.0, 0.0, 14, '', 0, 0, '1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783341_0.png', 0, 121, 127, 0, 1759918334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3485851287841797 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1388143820, 1388143263, 1388143018, 1388142955, 1388141636, 1388141589, 1388141441, 1388141386, 1388141341, 1388139863, 1388139810, 1388139140, 1388139138, 1388139135, 1388139131, 1388138521, 1388138520, 1388138435, 1388138401, 1388138337, 1388138157, 1388138106, 1388138103, 1388136748, 1388136657, 1388136655, 1388136652, 1388136650] Looping around the photos to save general results len do output : 80 /1388163026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388163325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143820', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143263', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143018', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388142955', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141636', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141589', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141441', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141386', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141341', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139863', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139810', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139140', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139138', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139135', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139131', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138521', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138520', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138435', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138401', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138337', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138157', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138106', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138103', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136748', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136657', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136655', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136652', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136650', None, None, None, None, None, '3885195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 268 time used for this insertion : 0.04482412338256836 save_final save missing photos in datou_result : time spend for datou_step_exec : 49.54274010658264 time spend to save output : 0.04801154136657715 total time spend for step 2 : 49.59075164794922 step3:rle_unique_nms_with_priority Wed Oct 8 12:12:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 80 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.9479274749755859 time for calcul the mask position with numpy : 0.29604172706604004 nb_pixel_total : 2041747 time to create 1 rle with new method : 0.1023702621459961 time for calcul the mask position with numpy : 0.006205081939697266 nb_pixel_total : 5720 time to create 1 rle with old method : 0.006702899932861328 time for calcul the mask position with numpy : 0.006213188171386719 nb_pixel_total : 8136 time to create 1 rle with old method : 0.009707927703857422 time for calcul the mask position with numpy : 0.007274150848388672 nb_pixel_total : 17997 time to create 1 rle with old method : 0.02108001708984375 create new chi : 0.46646690368652344 time to delete rle : 0.08832621574401855 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1848 TO DO : save crop sub photo not yet done ! save time : 0.36726975440979004 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.27231669425964355 time for calcul the mask position with numpy : 0.20407795906066895 nb_pixel_total : 2006340 time to create 1 rle with new method : 0.09958314895629883 time for calcul the mask position with numpy : 0.006210803985595703 nb_pixel_total : 5190 time to create 1 rle with old method : 0.0061228275299072266 time for calcul the mask position with numpy : 0.0063593387603759766 nb_pixel_total : 39610 time to create 1 rle with old method : 0.04636812210083008 time for calcul the mask position with numpy : 0.006205320358276367 nb_pixel_total : 6169 time to create 1 rle with old method : 0.007865428924560547 time for calcul the mask position with numpy : 0.006121158599853516 nb_pixel_total : 8917 time to create 1 rle with old method : 0.010383367538452148 time for calcul the mask position with numpy : 0.006351470947265625 nb_pixel_total : 7374 time to create 1 rle with old method : 0.008596420288085938 create new chi : 0.4305410385131836 time to delete rle : 0.0003936290740966797 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2482 TO DO : save crop sub photo not yet done ! save time : 0.41544198989868164 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06943821907043457 time for calcul the mask position with numpy : 0.02290964126586914 nb_pixel_total : 2057636 time to create 1 rle with new method : 0.13976311683654785 time for calcul the mask position with numpy : 0.006294965744018555 nb_pixel_total : 3051 time to create 1 rle with old method : 0.0035512447357177734 time for calcul the mask position with numpy : 0.006077766418457031 nb_pixel_total : 6830 time to create 1 rle with old method : 0.007883310317993164 time for calcul the mask position with numpy : 0.0061147212982177734 nb_pixel_total : 6083 time to create 1 rle with old method : 0.0070056915283203125 create new chi : 0.20665478706359863 time to delete rle : 0.00025343894958496094 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1522 TO DO : save crop sub photo not yet done ! save time : 0.31861090660095215 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.2146003246307373 time for calcul the mask position with numpy : 0.06828498840332031 nb_pixel_total : 1944170 time to create 1 rle with new method : 0.8702292442321777 time for calcul the mask position with numpy : 0.006204843521118164 nb_pixel_total : 8354 time to create 1 rle with old method : 0.009663820266723633 time for calcul the mask position with numpy : 0.008325338363647461 nb_pixel_total : 112657 time to create 1 rle with old method : 0.1298675537109375 time for calcul the mask position with numpy : 0.006176471710205078 nb_pixel_total : 2903 time to create 1 rle with old method : 0.0033745765686035156 time for calcul the mask position with numpy : 0.006211519241333008 nb_pixel_total : 2520 time to create 1 rle with old method : 0.002971172332763672 time for calcul the mask position with numpy : 0.006192207336425781 nb_pixel_total : 2996 time to create 1 rle with old method : 0.0038270950317382812 create new chi : 1.131493091583252 time to delete rle : 0.000278472900390625 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2708 TO DO : save crop sub photo not yet done ! save time : 0.47323179244995117 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.06459450721740723 time for calcul the mask position with numpy : 0.021369218826293945 nb_pixel_total : 2028846 time to create 1 rle with new method : 0.475078821182251 time for calcul the mask position with numpy : 0.006537675857543945 nb_pixel_total : 6319 time to create 1 rle with old method : 0.0075228214263916016 time for calcul the mask position with numpy : 0.0066258907318115234 nb_pixel_total : 23189 time to create 1 rle with old method : 0.027028560638427734 time for calcul the mask position with numpy : 0.00664520263671875 nb_pixel_total : 5723 time to create 1 rle with old method : 0.00675511360168457 time for calcul the mask position with numpy : 0.006452083587646484 nb_pixel_total : 9523 time to create 1 rle with old method : 0.011096000671386719 create new chi : 0.5830025672912598 time to delete rle : 0.0003898143768310547 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 2368 TO DO : save crop sub photo not yet done ! save time : 0.40859270095825195 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03394794464111328 time for calcul the mask position with numpy : 0.020398616790771484 nb_pixel_total : 2063875 time to create 1 rle with new method : 0.20443344116210938 time for calcul the mask position with numpy : 0.00697636604309082 nb_pixel_total : 9725 time to create 1 rle with old method : 0.016159534454345703 create new chi : 0.25702834129333496 time to delete rle : 0.0002734661102294922 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1304 TO DO : save crop sub photo not yet done ! save time : 0.29325342178344727 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.036418914794921875 time for calcul the mask position with numpy : 0.022052764892578125 nb_pixel_total : 2060238 time to create 1 rle with new method : 0.09505581855773926 time for calcul the mask position with numpy : 0.006738424301147461 nb_pixel_total : 13362 time to create 1 rle with old method : 0.01860833168029785 create new chi : 0.15013432502746582 time to delete rle : 0.00023865699768066406 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1336 TO DO : save crop sub photo not yet done ! save time : 0.3266417980194092 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.9219779968261719 time for calcul the mask position with numpy : 0.3140902519226074 nb_pixel_total : 1385818 time to create 1 rle with new method : 0.5852336883544922 time for calcul the mask position with numpy : 0.006299257278442383 nb_pixel_total : 4507 time to create 1 rle with old method : 0.005229949951171875 time for calcul the mask position with numpy : 0.010787487030029297 nb_pixel_total : 669338 time to create 1 rle with new method : 0.37243056297302246 time for calcul the mask position with numpy : 0.006517887115478516 nb_pixel_total : 5456 time to create 1 rle with old method : 0.006312847137451172 time for calcul the mask position with numpy : 0.006494760513305664 nb_pixel_total : 8481 time to create 1 rle with old method : 0.00986337661743164 create new chi : 1.3324546813964844 time to delete rle : 0.0006318092346191406 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3662 TO DO : save crop sub photo not yet done ! save time : 0.5527281761169434 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05784440040588379 time for calcul the mask position with numpy : 0.036563873291015625 nb_pixel_total : 2068184 time to create 1 rle with new method : 0.04259991645812988 time for calcul the mask position with numpy : 0.008628129959106445 nb_pixel_total : 5416 time to create 1 rle with old method : 0.010175228118896484 create new chi : 0.1080629825592041 time to delete rle : 0.000423431396484375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1364 TO DO : save crop sub photo not yet done ! save time : 0.28217411041259766 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.38279032707214355 time for calcul the mask position with numpy : 0.1199026107788086 nb_pixel_total : 2049251 time to create 1 rle with new method : 0.1027975082397461 time for calcul the mask position with numpy : 0.006806612014770508 nb_pixel_total : 3121 time to create 1 rle with old method : 0.00407862663269043 time for calcul the mask position with numpy : 0.006363868713378906 nb_pixel_total : 5579 time to create 1 rle with old method : 0.007318973541259766 time for calcul the mask position with numpy : 0.006554603576660156 nb_pixel_total : 10161 time to create 1 rle with old method : 0.013173580169677734 time for calcul the mask position with numpy : 0.006817817687988281 nb_pixel_total : 5488 time to create 1 rle with old method : 0.0067901611328125 create new chi : 0.2916889190673828 time to delete rle : 0.00036144256591796875 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 1958 TO DO : save crop sub photo not yet done ! save time : 0.3600454330444336 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.07193446159362793 time for calcul the mask position with numpy : 0.0272829532623291 nb_pixel_total : 2059165 time to create 1 rle with new method : 0.12378334999084473 time for calcul the mask position with numpy : 0.008709430694580078 nb_pixel_total : 3302 time to create 1 rle with old method : 0.0053958892822265625 time for calcul the mask position with numpy : 0.006577730178833008 nb_pixel_total : 5805 time to create 1 rle with old method : 0.007236480712890625 time for calcul the mask position with numpy : 0.007837295532226562 nb_pixel_total : 5328 time to create 1 rle with old method : 0.008331537246704102 create new chi : 0.20798182487487793 time to delete rle : 0.0005104541778564453 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1726 TO DO : save crop sub photo not yet done ! save time : 0.3256032466888428 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.16789937019348145 time for calcul the mask position with numpy : 0.060881614685058594 nb_pixel_total : 1940319 time to create 1 rle with new method : 0.4923441410064697 time for calcul the mask position with numpy : 0.007053375244140625 nb_pixel_total : 89695 time to create 1 rle with old method : 0.10323500633239746 time for calcul the mask position with numpy : 0.006933689117431641 nb_pixel_total : 29463 time to create 1 rle with old method : 0.03417491912841797 time for calcul the mask position with numpy : 0.0067632198333740234 nb_pixel_total : 7574 time to create 1 rle with old method : 0.009148120880126953 time for calcul the mask position with numpy : 0.006404399871826172 nb_pixel_total : 6549 time to create 1 rle with old method : 0.007680416107177734 create new chi : 0.7472867965698242 time to delete rle : 0.0005018711090087891 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2912 TO DO : save crop sub photo not yet done ! save time : 0.45424509048461914 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.07382392883300781 time for calcul the mask position with numpy : 0.012033939361572266 nb_pixel_total : 543469 time to create 1 rle with new method : 0.10815596580505371 time for calcul the mask position with numpy : 0.10830378532409668 nb_pixel_total : 1406044 time to create 1 rle with new method : 0.08785200119018555 time for calcul the mask position with numpy : 0.006313323974609375 nb_pixel_total : 5943 time to create 1 rle with old method : 0.006932258605957031 time for calcul the mask position with numpy : 0.006110429763793945 nb_pixel_total : 2159 time to create 1 rle with old method : 0.0028617382049560547 time for calcul the mask position with numpy : 0.006903171539306641 nb_pixel_total : 115985 time to create 1 rle with old method : 0.13939547538757324 create new chi : 0.5030765533447266 time to delete rle : 0.0008413791656494141 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 5506 TO DO : save crop sub photo not yet done ! save time : 0.7539746761322021 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.10732889175415039 time for calcul the mask position with numpy : 0.36196064949035645 nb_pixel_total : 1956122 time to create 1 rle with new method : 0.09747719764709473 time for calcul the mask position with numpy : 0.007179975509643555 nb_pixel_total : 103946 time to create 1 rle with old method : 0.11979556083679199 time for calcul the mask position with numpy : 0.006591796875 nb_pixel_total : 6204 time to create 1 rle with old method : 0.0073473453521728516 time for calcul the mask position with numpy : 0.006578683853149414 nb_pixel_total : 7328 time to create 1 rle with old method : 0.008517026901245117 create new chi : 0.6250951290130615 time to delete rle : 0.0006399154663085938 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2428 TO DO : save crop sub photo not yet done ! save time : 0.4034841060638428 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04228615760803223 time for calcul the mask position with numpy : 0.021358013153076172 nb_pixel_total : 2038258 time to create 1 rle with new method : 0.1636979579925537 time for calcul the mask position with numpy : 0.006509065628051758 nb_pixel_total : 3093 time to create 1 rle with old method : 0.0036160945892333984 time for calcul the mask position with numpy : 0.006563663482666016 nb_pixel_total : 32249 time to create 1 rle with old method : 0.03740525245666504 create new chi : 0.2497694492340088 time to delete rle : 0.0003116130828857422 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1718 TO DO : save crop sub photo not yet done ! save time : 0.326387882232666 No data in photo_id : 1388138521 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.519254207611084 time for calcul the mask position with numpy : 0.15496563911437988 nb_pixel_total : 2044300 time to create 1 rle with new method : 0.47590184211730957 time for calcul the mask position with numpy : 0.006677150726318359 nb_pixel_total : 5625 time to create 1 rle with old method : 0.009221553802490234 time for calcul the mask position with numpy : 0.006861209869384766 nb_pixel_total : 6468 time to create 1 rle with old method : 0.017490148544311523 time for calcul the mask position with numpy : 0.006437778472900391 nb_pixel_total : 10927 time to create 1 rle with old method : 0.012958049774169922 time for calcul the mask position with numpy : 0.006685733795166016 nb_pixel_total : 6280 time to create 1 rle with old method : 0.007325410842895508 create new chi : 0.7162425518035889 time to delete rle : 0.00038242340087890625 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1946 TO DO : save crop sub photo not yet done ! save time : 0.35443949699401855 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.037345170974731445 time for calcul the mask position with numpy : 0.0393831729888916 nb_pixel_total : 1243721 time to create 1 rle with new method : 0.3209824562072754 time for calcul the mask position with numpy : 0.017792224884033203 nb_pixel_total : 829879 time to create 1 rle with new method : 0.0633993148803711 create new chi : 0.44219303131103516 time to delete rle : 0.0003466606140136719 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 3232 TO DO : save crop sub photo not yet done ! save time : 0.5015602111816406 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05763673782348633 time for calcul the mask position with numpy : 0.022001028060913086 nb_pixel_total : 1943244 time to create 1 rle with new method : 0.23076987266540527 time for calcul the mask position with numpy : 0.008130073547363281 nb_pixel_total : 22851 time to create 1 rle with old method : 0.027076244354248047 time for calcul the mask position with numpy : 0.006619691848754883 nb_pixel_total : 8842 time to create 1 rle with old method : 0.010283470153808594 time for calcul the mask position with numpy : 0.0072498321533203125 nb_pixel_total : 98663 time to create 1 rle with old method : 0.11572599411010742 create new chi : 0.44266819953918457 time to delete rle : 0.0003883838653564453 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2702 TO DO : save crop sub photo not yet done ! save time : 0.45455050468444824 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.6393251419067383 time for calcul the mask position with numpy : 0.15365266799926758 nb_pixel_total : 2034765 time to create 1 rle with new method : 0.28861403465270996 time for calcul the mask position with numpy : 0.006273746490478516 nb_pixel_total : 9309 time to create 1 rle with old method : 0.010256052017211914 time for calcul the mask position with numpy : 0.0058901309967041016 nb_pixel_total : 11124 time to create 1 rle with old method : 0.012688159942626953 time for calcul the mask position with numpy : 0.005662202835083008 nb_pixel_total : 6124 time to create 1 rle with old method : 0.007548332214355469 time for calcul the mask position with numpy : 0.00577855110168457 nb_pixel_total : 12278 time to create 1 rle with old method : 0.015070199966430664 create new chi : 0.5223093032836914 time to delete rle : 0.0004096031188964844 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2158 TO DO : save crop sub photo not yet done ! save time : 0.40654587745666504 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.0590968132019043 time for calcul the mask position with numpy : 0.17487668991088867 nb_pixel_total : 1932194 time to create 1 rle with new method : 0.1570448875427246 time for calcul the mask position with numpy : 0.006369590759277344 nb_pixel_total : 5881 time to create 1 rle with old method : 0.0066585540771484375 time for calcul the mask position with numpy : 0.006284952163696289 nb_pixel_total : 19897 time to create 1 rle with old method : 0.024291515350341797 time for calcul the mask position with numpy : 0.0066967010498046875 nb_pixel_total : 112843 time to create 1 rle with old method : 0.13482952117919922 time for calcul the mask position with numpy : 0.006064653396606445 nb_pixel_total : 2785 time to create 1 rle with old method : 0.003104686737060547 create new chi : 0.5364460945129395 time to delete rle : 0.0004680156707763672 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2766 TO DO : save crop sub photo not yet done ! save time : 0.4501628875732422 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0499117374420166 time for calcul the mask position with numpy : 0.019774675369262695 nb_pixel_total : 1947015 time to create 1 rle with new method : 0.2655019760131836 time for calcul the mask position with numpy : 0.013792276382446289 nb_pixel_total : 115781 time to create 1 rle with old method : 0.1394176483154297 time for calcul the mask position with numpy : 0.006572723388671875 nb_pixel_total : 10804 time to create 1 rle with old method : 0.012965917587280273 create new chi : 0.45844507217407227 time to delete rle : 0.0004296302795410156 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2532 TO DO : save crop sub photo not yet done ! save time : 0.44019341468811035 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.052840471267700195 time for calcul the mask position with numpy : 0.028433799743652344 nb_pixel_total : 2067478 time to create 1 rle with new method : 0.10571861267089844 time for calcul the mask position with numpy : 0.006536722183227539 nb_pixel_total : 6122 time to create 1 rle with old method : 0.0071256160736083984 create new chi : 0.15576577186584473 time to delete rle : 0.0002567768096923828 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1346 TO DO : save crop sub photo not yet done ! save time : 0.2828373908996582 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.9145948886871338 time for calcul the mask position with numpy : 0.29168176651000977 nb_pixel_total : 1932636 time to create 1 rle with new method : 0.6279683113098145 time for calcul the mask position with numpy : 0.006621122360229492 nb_pixel_total : 2752 time to create 1 rle with old method : 0.003275156021118164 time for calcul the mask position with numpy : 0.0065021514892578125 nb_pixel_total : 24296 time to create 1 rle with old method : 0.03203701972961426 time for calcul the mask position with numpy : 0.009931802749633789 nb_pixel_total : 8060 time to create 1 rle with old method : 0.011677026748657227 time for calcul the mask position with numpy : 0.010497570037841797 nb_pixel_total : 7889 time to create 1 rle with old method : 0.010620594024658203 time for calcul the mask position with numpy : 0.008425712585449219 nb_pixel_total : 2870 time to create 1 rle with old method : 0.003980875015258789 time for calcul the mask position with numpy : 0.011201143264770508 nb_pixel_total : 95097 time to create 1 rle with old method : 0.1145017147064209 create new chi : 1.1593255996704102 time to delete rle : 0.0006725788116455078 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 3402 TO DO : save crop sub photo not yet done ! save time : 0.527888298034668 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.06603264808654785 time for calcul the mask position with numpy : 0.01921844482421875 nb_pixel_total : 2037470 time to create 1 rle with new method : 0.3742547035217285 time for calcul the mask position with numpy : 0.006074190139770508 nb_pixel_total : 8547 time to create 1 rle with old method : 0.009958982467651367 time for calcul the mask position with numpy : 0.00592041015625 nb_pixel_total : 2034 time to create 1 rle with old method : 0.0024080276489257812 time for calcul the mask position with numpy : 0.0064389705657958984 nb_pixel_total : 25549 time to create 1 rle with old method : 0.028253793716430664 create new chi : 0.452869176864624 time to delete rle : 0.0003535747528076172 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 1958 TO DO : save crop sub photo not yet done ! save time : 0.3580327033996582 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.056264400482177734 time for calcul the mask position with numpy : 0.019685745239257812 nb_pixel_total : 1957276 time to create 1 rle with new method : 0.12131881713867188 time for calcul the mask position with numpy : 0.006125211715698242 nb_pixel_total : 4428 time to create 1 rle with old method : 0.005589008331298828 time for calcul the mask position with numpy : 0.011563777923583984 nb_pixel_total : 105733 time to create 1 rle with old method : 0.12717485427856445 time for calcul the mask position with numpy : 0.006329536437988281 nb_pixel_total : 6163 time to create 1 rle with old method : 0.007307767868041992 create new chi : 0.31265854835510254 time to delete rle : 0.0005054473876953125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2546 TO DO : save crop sub photo not yet done ! save time : 0.431443452835083 No data in photo_id : 1388136652 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.09615015983581543 time for calcul the mask position with numpy : 0.0208127498626709 nb_pixel_total : 2064301 time to create 1 rle with new method : 0.11685872077941895 time for calcul the mask position with numpy : 0.006444215774536133 nb_pixel_total : 6315 time to create 1 rle with old method : 0.007442474365234375 time for calcul the mask position with numpy : 0.006452322006225586 nb_pixel_total : 2984 time to create 1 rle with old method : 0.003531932830810547 create new chi : 0.1726224422454834 time to delete rle : 0.0002689361572265625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1330 TO DO : save crop sub photo not yet done ! save time : 0.27930450439453125 map_output_result : {1388143820: (0.0, 'Should be the crop_list due to order', 0), 1388143263: (0.0, 'Should be the crop_list due to order', 0), 1388143018: (0.0, 'Should be the crop_list due to order', 0), 1388142955: (0.0, 'Should be the crop_list due to order', 0), 1388141636: (0.0, 'Should be the crop_list due to order', 0), 1388141589: (0.0, 'Should be the crop_list due to order', 0), 1388141441: (0.0, 'Should be the crop_list due to order', 0), 1388141386: (0.0, 'Should be the crop_list due to order', 0), 1388141341: (0.0, 'Should be the crop_list due to order', 0), 1388139863: (0.0, 'Should be the crop_list due to order', 0), 1388139810: (0.0, 'Should be the crop_list due to order', 0), 1388139140: (0.0, 'Should be the crop_list due to order', 0), 1388139138: (0.0, 'Should be the crop_list due to order', 0), 1388139135: (0.0, 'Should be the crop_list due to order', 0), 1388139131: (0.0, 'Should be the crop_list due to order', 0), 1388138521: (0.0, 'Should be the crop_list due to order', 0.0), 1388138520: (0.0, 'Should be the crop_list due to order', 0), 1388138435: (0.0, 'Should be the crop_list due to order', 0), 1388138401: (0.0, 'Should be the crop_list due to order', 0), 1388138337: (0.0, 'Should be the crop_list due to order', 0), 1388138157: (0.0, 'Should be the crop_list due to order', 0), 1388138106: (0.0, 'Should be the crop_list due to order', 0), 1388138103: (0.0, 'Should be the crop_list due to order', 0), 1388136748: (0.0, 'Should be the crop_list due to order', 0), 1388136657: (0.0, 'Should be the crop_list due to order', 0), 1388136655: (0.0, 'Should be the crop_list due to order', 0), 1388136652: (0.0, 'Should be the crop_list due to order', 0.0), 1388136650: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1388143820, 1388143263, 1388143018, 1388142955, 1388141636, 1388141589, 1388141441, 1388141386, 1388141341, 1388139863, 1388139810, 1388139140, 1388139138, 1388139135, 1388139131, 1388138521, 1388138520, 1388138435, 1388138401, 1388138337, 1388138157, 1388138106, 1388138103, 1388136748, 1388136657, 1388136655, 1388136652, 1388136650] Looping around the photos to save general results len do output : 28 /1388143820.Didn't retrieve data . /1388143263.Didn't retrieve data . /1388143018.Didn't retrieve data . /1388142955.Didn't retrieve data . /1388141636.Didn't retrieve data . /1388141589.Didn't retrieve data . /1388141441.Didn't retrieve data . /1388141386.Didn't retrieve data . /1388141341.Didn't retrieve data . /1388139863.Didn't retrieve data . /1388139810.Didn't retrieve data . /1388139140.Didn't retrieve data . /1388139138.Didn't retrieve data . /1388139135.Didn't retrieve data . /1388139131.Didn't retrieve data . /1388138521.Didn't retrieve data . /1388138520.Didn't retrieve data . /1388138435.Didn't retrieve data . /1388138401.Didn't retrieve data . /1388138337.Didn't retrieve data . /1388138157.Didn't retrieve data . /1388138106.Didn't retrieve data . /1388138103.Didn't retrieve data . /1388136748.Didn't retrieve data . /1388136657.Didn't retrieve data . /1388136655.Didn't retrieve data . /1388136652.Didn't retrieve data . /1388136650.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143820', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143263', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143018', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388142955', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141636', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141589', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141441', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141386', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141341', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139863', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139810', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139140', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139138', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139135', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139131', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138521', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138520', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138435', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138401', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138337', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138157', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138106', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138103', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136748', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136657', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136655', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136652', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136650', None, None, None, None, None, '3885195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.03828763961791992 save_final save missing photos in datou_result : time spend for datou_step_exec : 30.33053183555603 time spend to save output : 0.03960895538330078 total time spend for step 3 : 30.37014079093933 step4:ventilate_hashtags_in_portfolio Wed Oct 8 12:12:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27592231 get user id for portfolio 27592231 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592231 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','environnement','metal','autre','pehd','papier','background','mal_croppe','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592231 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','environnement','metal','autre','pehd','papier','background','mal_croppe','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592231 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','environnement','metal','autre','pehd','papier','background','mal_croppe','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27592764,27592765,27592766,27592767,27592768,27592769,27592770,27592771,27592772,27592773,27592774?tags=flou,pet_clair,environnement,metal,autre,pehd,papier,background,mal_croppe,carton,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1388143820, 1388143263, 1388143018, 1388142955, 1388141636, 1388141589, 1388141441, 1388141386, 1388141341, 1388139863, 1388139810, 1388139140, 1388139138, 1388139135, 1388139131, 1388138521, 1388138520, 1388138435, 1388138401, 1388138337, 1388138157, 1388138106, 1388138103, 1388136748, 1388136657, 1388136655, 1388136652, 1388136650] Looping around the photos to save general results len do output : 1 /27592231. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143820', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143263', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143018', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388142955', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141636', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141589', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141441', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141386', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141341', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139863', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139810', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139140', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139138', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139135', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139131', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138521', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138520', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138435', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138401', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138337', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138157', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138106', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138103', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136748', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136657', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136655', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136652', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136650', None, None, None, None, None, '3885195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.04268360137939453 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.503320693969727 time spend to save output : 0.04315376281738281 total time spend for step 4 : 5.546474456787109 step5:final Wed Oct 8 12:12:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1388143820: ('0.07691526813271601',), 1388143263: ('0.07691526813271601',), 1388143018: ('0.07691526813271601',), 1388142955: ('0.07691526813271601',), 1388141636: ('0.07691526813271601',), 1388141589: ('0.07691526813271601',), 1388141441: ('0.07691526813271601',), 1388141386: ('0.07691526813271601',), 1388141341: ('0.07691526813271601',), 1388139863: ('0.07691526813271601',), 1388139810: ('0.07691526813271601',), 1388139140: ('0.07691526813271601',), 1388139138: ('0.07691526813271601',), 1388139135: ('0.07691526813271601',), 1388139131: ('0.07691526813271601',), 1388138521: ('0.07691526813271601',), 1388138520: ('0.07691526813271601',), 1388138435: ('0.07691526813271601',), 1388138401: ('0.07691526813271601',), 1388138337: ('0.07691526813271601',), 1388138157: ('0.07691526813271601',), 1388138106: ('0.07691526813271601',), 1388138103: ('0.07691526813271601',), 1388136748: ('0.07691526813271601',), 1388136657: ('0.07691526813271601',), 1388136655: ('0.07691526813271601',), 1388136652: ('0.07691526813271601',), 1388136650: ('0.07691526813271601',)} new output for save of step final : {1388143820: ('0.07691526813271601',), 1388143263: ('0.07691526813271601',), 1388143018: ('0.07691526813271601',), 1388142955: ('0.07691526813271601',), 1388141636: ('0.07691526813271601',), 1388141589: ('0.07691526813271601',), 1388141441: ('0.07691526813271601',), 1388141386: ('0.07691526813271601',), 1388141341: ('0.07691526813271601',), 1388139863: ('0.07691526813271601',), 1388139810: ('0.07691526813271601',), 1388139140: ('0.07691526813271601',), 1388139138: ('0.07691526813271601',), 1388139135: ('0.07691526813271601',), 1388139131: ('0.07691526813271601',), 1388138521: ('0.07691526813271601',), 1388138520: ('0.07691526813271601',), 1388138435: ('0.07691526813271601',), 1388138401: ('0.07691526813271601',), 1388138337: ('0.07691526813271601',), 1388138157: ('0.07691526813271601',), 1388138106: ('0.07691526813271601',), 1388138103: ('0.07691526813271601',), 1388136748: ('0.07691526813271601',), 1388136657: ('0.07691526813271601',), 1388136655: ('0.07691526813271601',), 1388136652: ('0.07691526813271601',), 1388136650: ('0.07691526813271601',)} [1388143820, 1388143263, 1388143018, 1388142955, 1388141636, 1388141589, 1388141441, 1388141386, 1388141341, 1388139863, 1388139810, 1388139140, 1388139138, 1388139135, 1388139131, 1388138521, 1388138520, 1388138435, 1388138401, 1388138337, 1388138157, 1388138106, 1388138103, 1388136748, 1388136657, 1388136655, 1388136652, 1388136650] Looping around the photos to save general results len do output : 28 /1388143820.Didn't retrieve data . /1388143263.Didn't retrieve data . /1388143018.Didn't retrieve data . /1388142955.Didn't retrieve data . /1388141636.Didn't retrieve data . /1388141589.Didn't retrieve data . /1388141441.Didn't retrieve data . /1388141386.Didn't retrieve data . /1388141341.Didn't retrieve data . /1388139863.Didn't retrieve data . /1388139810.Didn't retrieve data . /1388139140.Didn't retrieve data . /1388139138.Didn't retrieve data . /1388139135.Didn't retrieve data . /1388139131.Didn't retrieve data . /1388138521.Didn't retrieve data . /1388138520.Didn't retrieve data . /1388138435.Didn't retrieve data . /1388138401.Didn't retrieve data . /1388138337.Didn't retrieve data . /1388138157.Didn't retrieve data . /1388138106.Didn't retrieve data . /1388138103.Didn't retrieve data . /1388136748.Didn't retrieve data . /1388136657.Didn't retrieve data . /1388136655.Didn't retrieve data . /1388136652.Didn't retrieve data . /1388136650.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143820', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143263', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143018', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388142955', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141636', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141589', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141441', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141386', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141341', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139863', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139810', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139140', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139138', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139135', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139131', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138521', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138520', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138435', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138401', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138337', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138157', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138106', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138103', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136748', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136657', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136655', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136652', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136650', None, None, None, None, None, '3885195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.053050994873046875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.36909031867980957 time spend to save output : 0.0543217658996582 total time spend for step 5 : 0.4234120845794678 step6:blur_detection Wed Oct 8 12:12:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964.jpg resize: (1080, 1920) 1388143820 -0.1268046233386643 treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63.jpg resize: (1080, 1920) 1388143263 -0.532144294149387 treat image : temp/1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775.jpg resize: (1080, 1920) 1388143018 0.5493612709129057 treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e.jpg resize: (1080, 1920) 1388142955 -0.5257015070138563 treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363.jpg resize: (1080, 1920) 1388141636 -1.2620760104661548 treat image : temp/1759918229_3054074_1388141589_c339060415463fbe45b424f4dfa98203.jpg resize: (1080, 1920) 1388141589 -1.0005294911669145 treat image : temp/1759918229_3054074_1388141441_09b91516568d38e9b5c5b39e625cf30d.jpg resize: (1080, 1920) 1388141441 0.39265453445343473 treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640.jpg resize: (1080, 1920) 1388141386 -0.665027064804495 treat image : temp/1759918229_3054074_1388141341_b3d7d9526e4f2a34ec4d765e6666440b.jpg resize: (1080, 1920) 1388141341 0.2523612708911612 treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e.jpg resize: (1080, 1920) 1388139863 -1.6456344004427657 treat image : temp/1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da.jpg resize: (1080, 1920) 1388139810 1.7723686641405314 treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb.jpg resize: (1080, 1920) 1388139140 -1.1949703170822572 treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5.jpg resize: (1080, 1920) 1388139138 -1.4239538397460063 treat image : temp/1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52.jpg resize: (1080, 1920) 1388139135 -2.3190208670613575 treat image : temp/1759918229_3054074_1388139131_251393d06285aa9a3d75c9f33ee2c276.jpg resize: (1080, 1920) 1388139131 -1.6252010495562261 treat image : temp/1759918229_3054074_1388138521_cbbf9366e13bdeaf75abae6e2c533bee.jpg resize: (1080, 1920) 1388138521 -2.0022966285936348 treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3.jpg resize: (1080, 1920) 1388138520 1.5132994552159922 treat image : temp/1759918229_3054074_1388138435_69d2778d910bc1db89a7b8f915b12fa5.jpg resize: (1080, 1920) 1388138435 -1.5367768669628097 treat image : temp/1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710.jpg resize: (1080, 1920) 1388138401 -1.472305254237868 treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06.jpg resize: (1080, 1920) 1388138337 -1.891990646635244 treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc.jpg resize: (1080, 1920) 1388138157 -1.8671875172395276 treat image : temp/1759918229_3054074_1388138106_dd0b24306c25b2438e9425e84a025f73.jpg resize: (1080, 1920) 1388138106 0.643792166324063 treat image : temp/1759918229_3054074_1388138103_63697c3675aa50a9ed43cb0fccdee557.jpg resize: (1080, 1920) 1388138103 0.2104158700075106 treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3.jpg resize: (1080, 1920) 1388136748 -1.6503320945837303 treat image : temp/1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b.jpg resize: (1080, 1920) 1388136657 -1.9115164264317022 treat image : temp/1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2.jpg resize: (1080, 1920) 1388136655 -2.8656628023312383 treat image : temp/1759918229_3054074_1388136652_a0127ada66d635f52efd13f02ba43cea.jpg resize: (1080, 1920) 1388136652 -2.0888301500285245 treat image : temp/1759918229_3054074_1388136650_be13b57459b65260ce32588338de033e.jpg resize: (1080, 1920) 1388136650 -1.7673847418602533 treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783270_0.png resize: (106, 123) 1388163026 -0.006893781463490333 treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783271_0.png resize: (147, 89) 1388163039 -0.02367026794658591 treat image : temp/1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783276_0.png resize: (92, 96) 1388163053 0.08874378214540408 treat image : temp/1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783275_0.png resize: (83, 87) 1388163066 -0.3489729184111588 treat image : temp/1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783277_0.png resize: (59, 80) 1388163081 -2.6717067861424306 treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783278_0.png resize: (74, 111) 1388163095 -0.08662029509733475 treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783280_0.png resize: (62, 62) 1388163109 2.5936795996105584 treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783279_0.png resize: (55, 55) 1388163123 20.0 treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783285_0.png resize: (159, 239) 1388163127 -3.2954980453462146 treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783283_0.png resize: (113, 142) 1388163128 -2.69459077768031 treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783286_0.png resize: (128, 123) 1388163129 -2.5361291138104205 treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783284_0.png resize: (109, 97) 1388163130 -3.049564828535021 treat image : temp/1759918229_3054074_1388141589_c339060415463fbe45b424f4dfa98203_rle_crop_3988783287_0.png resize: (112, 122) 1388163131 -0.032720459187038 treat image : temp/1759918229_3054074_1388141441_09b91516568d38e9b5c5b39e625cf30d_rle_crop_3988783288_0.png resize: (128, 143) 1388163132 -2.156079304329744 treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783289_0.png resize: (92, 147) 1388163133 1.3746220666194326 treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783290_0.png resize: (103, 122) 1388163134 -0.643008126185432 treat image : temp/1759918229_3054074_1388141341_b3d7d9526e4f2a34ec4d765e6666440b_rle_crop_3988783293_0.png resize: (142, 56) 1388163135 -1.4983975605377846 treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783297_0.png resize: (73, 81) 1388163136 -2.66339025269571 treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783294_0.png resize: (148, 69) 1388163137 -2.1600165866130343 treat image : temp/1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783300_0.png resize: (72, 70) 1388163138 -3.897916698240369 treat image : temp/1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783298_0.png resize: (141, 75) 1388163139 -2.262807571374022 treat image : temp/1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783299_0.png resize: (110, 97) 1388163140 -3.1582399059610697 treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783301_0.png resize: (150, 80) 1388163141 -2.3788200930951793 treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783307_0.png resize: (94, 128) 1388163142 -2.2927445068837113 treat image : temp/1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783309_0.png resize: (82, 123) 1388163143 -0.9637420471056702 treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783314_0.png resize: (153, 75) 1388163144 -2.402495387330028 treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783316_0.png resize: (73, 117) 1388163146 0.49542539609019376 treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783317_0.png resize: (106, 94) 1388163147 -3.601924536771226 treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783322_0.png resize: (130, 156) 1388163148 -2.129670698937384 treat image : temp/1759918229_3054074_1388138103_63697c3675aa50a9ed43cb0fccdee557_rle_crop_3988783332_0.png resize: (133, 80) 1388163149 -1.9590389234934331 treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783336_0.png resize: (168, 98) 1388163150 -1.6686560571527287 treat image : temp/1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783340_0.png resize: (62, 54) 1388163151 -1.3885154163650335 treat image : temp/1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783342_0.png resize: (150, 74) 1388163152 -2.0703071027117006 treat image : temp/1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783344_0.png resize: (75, 81) 1388163153 -0.3131652036260281 treat image : temp/1759918229_3054074_1388136650_be13b57459b65260ce32588338de033e_rle_crop_3988783346_0.png resize: (68, 133) 1388163154 -0.7825991538638668 treat image : temp/1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783269_0.png resize: (99, 88) 1388163157 -1.1500765698363222 treat image : temp/1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783267_0.png resize: (155, 137) 1388163158 0.5729877375422057 treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783282_0.png resize: (97, 94) 1388163159 20.0 treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783281_0.png resize: (515, 368) 1388163160 -0.21289337222065544 treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783292_0.png resize: (95, 76) 1388163161 -1.752996447882459 treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783315_0.png resize: (98, 177) 1388163162 -2.0037022393884016 treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783328_0.png resize: (171, 180) 1388163163 -2.232661085089371 treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783338_0.png resize: (88, 42) 1388163164 1.1463960612181299 treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783335_0.png resize: (81, 131) 1388163165 -0.5760674181601967 treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783296_0.png resize: (61, 113) 1388163167 -2.9742722932956696 treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783302_0.png resize: (98, 99) 1388163168 -0.04051743221887088 treat image : temp/1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783268_0.png resize: (104, 152) 1388163238 -1.077024514269353 treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783273_0.png resize: (231, 211) 1388163239 -0.42743678354858655 treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783272_0.png resize: (121, 62) 1388163240 -2.3985357102231566 treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783274_0.png resize: (90, 74) 1388163241 1.015830445739359 treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783291_0.png resize: (977, 952) 1388163242 0.06734998322308813 treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783295_0.png resize: (127, 114) 1388163243 -1.873743276641687 treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783303_0.png resize: (165, 266) 1388163244 -3.9619426690940727 treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783304_0.png resize: (496, 315) 1388163245 -0.04737168343448529 treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783308_0.png resize: (955, 1728) 1388163246 -1.9224133821094573 treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783305_0.png resize: (504, 352) 1388163247 0.19510748038346643 treat image : temp/1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783311_0.png resize: (507, 333) 1388163248 0.30900410389436644 treat image : temp/1759918229_3054074_1388139131_251393d06285aa9a3d75c9f33ee2c276_rle_crop_3988783312_0.png resize: (252, 263) 1388163249 -1.8189236057017355 treat image : temp/1759918229_3054074_1388138435_69d2778d910bc1db89a7b8f915b12fa5_rle_crop_3988783318_0.png resize: (980, 1181) 1388163250 0.0815557532916463 treat image : temp/1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783321_0.png resize: (200, 178) 1388163251 -1.8965433816497879 treat image : temp/1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783320_0.png resize: (104, 101) 1388163252 -1.422499508465811 treat image : temp/1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783319_0.png resize: (498, 317) 1388163253 0.5420568116049997 treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783325_0.png resize: (134, 112) 1388163254 -4.115799919326301 treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783324_0.png resize: (155, 99) 1388163255 -2.713013578842608 treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783326_0.png resize: (57, 60) 1388163256 -3.1520334446210163 treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783327_0.png resize: (520, 340) 1388163258 -0.05514520587756369 treat image : temp/1759918229_3054074_1388138106_dd0b24306c25b2438e9425e84a025f73_rle_crop_3988783331_0.png resize: (537, 372) 1388163259 0.1394633202753283 treat image : temp/1759918229_3054074_1388138106_dd0b24306c25b2438e9425e84a025f73_rle_crop_3988783330_0.png resize: (182, 107) 1388163260 -2.557290863290874 treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783337_0.png resize: (232, 127) 1388163261 -1.9865001790596113 treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783333_0.png resize: (494, 295) 1388163262 -0.062239153785001104 treat image : temp/1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783339_0.png resize: (208, 175) 1388163263 -2.8941886442977838 treat image : temp/1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783343_0.png resize: (508, 368) 1388163264 0.27278628502563823 treat image : temp/1759918229_3054074_1388136650_be13b57459b65260ce32588338de033e_rle_crop_3988783345_0.png resize: (52, 71) 1388163265 -0.32409006979470134 treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783306_0.png resize: (59, 50) 1388163319 -0.7561929770142385 treat image : temp/1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783310_0.png resize: (83, 96) 1388163320 0.35480362851679975 treat image : temp/1759918229_3054074_1388139131_251393d06285aa9a3d75c9f33ee2c276_rle_crop_3988783313_0.png resize: (66, 63) 1388163321 0.6496411570778693 treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783323_0.png resize: (93, 87) 1388163322 1.9284221911300696 treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783329_0.png resize: (89, 83) 1388163323 0.7123927085079498 treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783334_0.png resize: (63, 62) 1388163324 0.20818806797521563 treat image : temp/1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783341_0.png resize: (127, 121) 1388163325 -2.209342653841597 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 108 time used for this insertion : 0.040607452392578125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 108 time used for this insertion : 0.07469797134399414 save missing photos in datou_result : time spend for datou_step_exec : 24.42705488204956 time spend to save output : 0.1336832046508789 total time spend for step 6 : 24.56073808670044 step7:brightness Wed Oct 8 12:13:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964.jpg treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63.jpg treat image : temp/1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775.jpg treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e.jpg treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363.jpg treat image : temp/1759918229_3054074_1388141589_c339060415463fbe45b424f4dfa98203.jpg treat image : temp/1759918229_3054074_1388141441_09b91516568d38e9b5c5b39e625cf30d.jpg treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640.jpg treat image : temp/1759918229_3054074_1388141341_b3d7d9526e4f2a34ec4d765e6666440b.jpg treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e.jpg treat image : temp/1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da.jpg treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb.jpg treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5.jpg treat image : temp/1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52.jpg treat image : temp/1759918229_3054074_1388139131_251393d06285aa9a3d75c9f33ee2c276.jpg treat image : temp/1759918229_3054074_1388138521_cbbf9366e13bdeaf75abae6e2c533bee.jpg treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3.jpg treat image : temp/1759918229_3054074_1388138435_69d2778d910bc1db89a7b8f915b12fa5.jpg treat image : temp/1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710.jpg treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06.jpg treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc.jpg treat image : temp/1759918229_3054074_1388138106_dd0b24306c25b2438e9425e84a025f73.jpg treat image : temp/1759918229_3054074_1388138103_63697c3675aa50a9ed43cb0fccdee557.jpg treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3.jpg treat image : temp/1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b.jpg treat image : temp/1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2.jpg treat image : temp/1759918229_3054074_1388136652_a0127ada66d635f52efd13f02ba43cea.jpg treat image : temp/1759918229_3054074_1388136650_be13b57459b65260ce32588338de033e.jpg treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783270_0.png treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783271_0.png treat image : temp/1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783276_0.png treat image : temp/1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783275_0.png treat image : temp/1759918229_3054074_1388143018_2ba409a3780518d8905866a32a91c775_rle_crop_3988783277_0.png treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783278_0.png treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783280_0.png treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783279_0.png treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783285_0.png treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783283_0.png treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783286_0.png treat image : temp/1759918229_3054074_1388141636_14ad060d3f74237ca34e5b6de0bf2363_rle_crop_3988783284_0.png treat image : temp/1759918229_3054074_1388141589_c339060415463fbe45b424f4dfa98203_rle_crop_3988783287_0.png treat image : temp/1759918229_3054074_1388141441_09b91516568d38e9b5c5b39e625cf30d_rle_crop_3988783288_0.png treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783289_0.png treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783290_0.png treat image : temp/1759918229_3054074_1388141341_b3d7d9526e4f2a34ec4d765e6666440b_rle_crop_3988783293_0.png treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783297_0.png treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783294_0.png treat image : temp/1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783300_0.png treat image : temp/1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783298_0.png treat image : temp/1759918229_3054074_1388139810_1ab1c2aa109323dbad0fa57b3229c6da_rle_crop_3988783299_0.png treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783301_0.png treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783307_0.png treat image : temp/1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783309_0.png treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783314_0.png treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783316_0.png treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783317_0.png treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783322_0.png treat image : temp/1759918229_3054074_1388138103_63697c3675aa50a9ed43cb0fccdee557_rle_crop_3988783332_0.png treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783336_0.png treat image : temp/1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783340_0.png treat image : temp/1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783342_0.png treat image : temp/1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783344_0.png treat image : temp/1759918229_3054074_1388136650_be13b57459b65260ce32588338de033e_rle_crop_3988783346_0.png treat image : temp/1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783269_0.png treat image : temp/1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783267_0.png treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783282_0.png treat image : temp/1759918229_3054074_1388142955_3cc5198ebd984cd3489b336cf8af157e_rle_crop_3988783281_0.png treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783292_0.png treat image : temp/1759918229_3054074_1388138520_c8c0247ff93be6ebbd3749601e723ce3_rle_crop_3988783315_0.png treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783328_0.png treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783338_0.png treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783335_0.png treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783296_0.png treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783302_0.png treat image : temp/1759918229_3054074_1388143820_8ca0b4db5fc7df3607a02412e8211964_rle_crop_3988783268_0.png treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783273_0.png treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783272_0.png treat image : temp/1759918229_3054074_1388143263_c3c6b79f32fe3df07639886c00d35a63_rle_crop_3988783274_0.png treat image : temp/1759918229_3054074_1388141386_9a325a37ad58ef1f7429113415fb4640_rle_crop_3988783291_0.png treat image : temp/1759918229_3054074_1388139863_ce78b3c287a152dba407b30e1f01250e_rle_crop_3988783295_0.png treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783303_0.png treat image : temp/1759918229_3054074_1388139140_74fd79d6fc2966505e24561c2638e6eb_rle_crop_3988783304_0.png treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783308_0.png treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783305_0.png treat image : temp/1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783311_0.png treat image : temp/1759918229_3054074_1388139131_251393d06285aa9a3d75c9f33ee2c276_rle_crop_3988783312_0.png treat image : temp/1759918229_3054074_1388138435_69d2778d910bc1db89a7b8f915b12fa5_rle_crop_3988783318_0.png treat image : temp/1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783321_0.png treat image : temp/1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783320_0.png treat image : temp/1759918229_3054074_1388138401_4bb6d8dd51d5379e2bbaca4a9ae6a710_rle_crop_3988783319_0.png treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783325_0.png treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783324_0.png treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783326_0.png treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783327_0.png treat image : temp/1759918229_3054074_1388138106_dd0b24306c25b2438e9425e84a025f73_rle_crop_3988783331_0.png treat image : temp/1759918229_3054074_1388138106_dd0b24306c25b2438e9425e84a025f73_rle_crop_3988783330_0.png treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783337_0.png treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783333_0.png treat image : temp/1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783339_0.png treat image : temp/1759918229_3054074_1388136655_a912ed96078a2db7464734e810bee7b2_rle_crop_3988783343_0.png treat image : temp/1759918229_3054074_1388136650_be13b57459b65260ce32588338de033e_rle_crop_3988783345_0.png treat image : temp/1759918229_3054074_1388139138_0aceda9e661c845e7b6ded6f0e53aae5_rle_crop_3988783306_0.png treat image : temp/1759918229_3054074_1388139135_365f7f25fe27f11593bc33f2ab4a3c52_rle_crop_3988783310_0.png treat image : temp/1759918229_3054074_1388139131_251393d06285aa9a3d75c9f33ee2c276_rle_crop_3988783313_0.png treat image : temp/1759918229_3054074_1388138337_0ce1e46aa57aa7bc49e7d8f23cf08e06_rle_crop_3988783323_0.png treat image : temp/1759918229_3054074_1388138157_406722d9b40d8470b365d9d5a4965bfc_rle_crop_3988783329_0.png treat image : temp/1759918229_3054074_1388136748_a887aef9e2b3c88ffc114673375b6da3_rle_crop_3988783334_0.png treat image : temp/1759918229_3054074_1388136657_c8b5f6b60908e2813b6be8fea844d00b_rle_crop_3988783341_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 108 time used for this insertion : 0.0425565242767334 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 108 time used for this insertion : 0.07587981224060059 save missing photos in datou_result : time spend for datou_step_exec : 6.982061386108398 time spend to save output : 0.137131929397583 total time spend for step 7 : 7.1191933155059814 step8:velours_tree Wed Oct 8 12:13:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15592360496520996 time spend to save output : 3.790855407714844e-05 total time spend for step 8 : 0.1559615135192871 step9:send_mail_cod Wed Oct 8 12:13:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27592231_08-10-2025_12_13_23.pdf 27592764 imagette275927641759918403 27592765 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette275927651759918403 27592767 change filename to text .change filename to text .imagette275927671759918405 27592768 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette275927681759918405 27592769 imagette275927691759918405 27592770 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette275927701759918405 27592771 imagette275927711759918407 27592772 imagette275927721759918407 27592773 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette275927731759918407 27592774 imagette275927741759918407 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27592231 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27592764,27592765,27592766,27592767,27592768,27592769,27592770,27592771,27592772,27592773,27592774?tags=flou,pet_clair,environnement,metal,autre,pehd,papier,background,mal_croppe,carton,pet_fonce args[1388143820] : ((1388143820, -0.1268046233386643, 492688767), (1388143820, 0.9518016017818566, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388143263] : ((1388143263, -0.532144294149387, 492688767), (1388143263, 0.6166428971251369, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388143018] : ((1388143018, 0.5493612709129057, 492688767), (1388143018, 0.80292963025004, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388142955] : ((1388142955, -0.5257015070138563, 492688767), (1388142955, 0.6467615868969685, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388141636] : ((1388141636, -1.2620760104661548, 492688767), (1388141636, 0.6818431467394582, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388141589] : ((1388141589, -1.0005294911669145, 492688767), (1388141589, 1.4333109572722431, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388141441] : ((1388141441, 0.39265453445343473, 492688767), (1388141441, 0.645096408968221, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388141386] : ((1388141386, -0.665027064804495, 492688767), (1388141386, 0.6321273852638537, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388141341] : ((1388141341, 0.2523612708911612, 492688767), (1388141341, 0.7348405345281028, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388139863] : ((1388139863, -1.6456344004427657, 492688767), (1388139863, 0.3589324974177574, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388139810] : ((1388139810, 1.7723686641405314, 492688767), (1388139810, 0.24119895971938535, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388139140] : ((1388139140, -1.1949703170822572, 492688767), (1388139140, 0.7034402659894273, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388139138] : ((1388139138, -1.4239538397460063, 492688767), (1388139138, 0.2696169896938242, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388139135] : ((1388139135, -2.3190208670613575, 492609224), (1388139135, 0.2824176801625005, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388139131] : ((1388139131, -1.6252010495562261, 492688767), (1388139131, 0.40247252111220816, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388138521] : ((1388138521, -2.0022966285936348, 492609224), (1388138521, 0.3812524223810433, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388138520] : ((1388138520, 1.5132994552159922, 492688767), (1388138520, 0.24129775185683552, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388138435] : ((1388138435, -1.5367768669628097, 492688767), (1388138435, 0.36667957416103814, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388138401] : ((1388138401, -1.472305254237868, 492688767), (1388138401, 0.41567997696447284, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388138337] : ((1388138337, -1.891990646635244, 492688767), (1388138337, 0.5563304441060873, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388138157] : ((1388138157, -1.8671875172395276, 492688767), (1388138157, 0.3532104145732453, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388138106] : ((1388138106, 0.643792166324063, 492688767), (1388138106, 0.4646962787461511, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388138103] : ((1388138103, 0.2104158700075106, 492688767), (1388138103, 0.44407160933805756, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388136748] : ((1388136748, -1.6503320945837303, 492688767), (1388136748, 0.6011018346523275, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388136657] : ((1388136657, -1.9115164264317022, 492688767), (1388136657, 0.42015562540460283, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388136655] : ((1388136655, -2.8656628023312383, 492609224), (1388136655, 0.4031165075676829, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388136652] : ((1388136652, -2.0888301500285245, 492609224), (1388136652, 0.5384013998090388, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com args[1388136650] : ((1388136650, -1.7673847418602533, 492688767), (1388136650, 0.4714746609480028, 2107752395), '0.07691526813271601') We are sending mail with results at report@fotonower.com refus_total : 0.07691526813271601 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27592231 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592231_08-10-2025_12_13_23.pdf results_Auto_P27592231_08-10-2025_12_13_23.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592231_08-10-2025_12_13_23.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27592231','results_Auto_P27592231_08-10-2025_12_13_23.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592231_08-10-2025_12_13_23.pdf','pdf','','0.57','0.07691526813271601') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27592231

https://www.fotonower.com/image?json=false&list_photos_id=1388143820
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388143263
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388143018
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388142955
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388141636
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388141589
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388141441
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388141386
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388141341
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388139863
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388139810
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.7723686641405314)
https://www.fotonower.com/image?json=false&list_photos_id=1388139140
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388139138
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388139135
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388139131
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388138521
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388138520
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5132994552159922)
https://www.fotonower.com/image?json=false&list_photos_id=1388138435
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388138401
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388138337
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388138157
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388138106
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388138103
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388136748
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388136657
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388136655
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388136652
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388136650
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 7.69%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/27592765?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27592767?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27592768?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27592770?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27592773?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592231_08-10-2025_12_13_23.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27592764,27592765,27592766,27592767,27592768,27592769,27592770,27592771,27592772,27592773,27592774?tags=flou,pet_clair,environnement,metal,autre,pehd,papier,background,mal_croppe,carton,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 08 Oct 2025 10:13:31 GMT Content-Length: 0 Connection: close X-Message-Id: cvlkf0IyQo-UARzEOmhBgw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1388143820, 1388143263, 1388143018, 1388142955, 1388141636, 1388141589, 1388141441, 1388141386, 1388141341, 1388139863, 1388139810, 1388139140, 1388139138, 1388139135, 1388139131, 1388138521, 1388138520, 1388138435, 1388138401, 1388138337, 1388138157, 1388138106, 1388138103, 1388136748, 1388136657, 1388136655, 1388136652, 1388136650] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143820', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143263', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143018', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388142955', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141636', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141589', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141441', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141386', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141341', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139863', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139810', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139140', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139138', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139135', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139131', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138521', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138520', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138435', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138401', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138337', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138157', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138106', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138103', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136748', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136657', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136655', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136652', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136650', None, None, None, None, None, '3885195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 28 time used for this insertion : 0.03887486457824707 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.041162490844727 time spend to save output : 0.0392301082611084 total time spend for step 9 : 8.080392599105835 step10:split_time_score Wed Oct 8 12:13:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 28),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08102025 27592231 Nombre de photos uploadées : 28 / 23040 (0%) 08102025 27592231 Nombre de photos taguées (types de déchets): 0 / 28 (0%) 08102025 27592231 Nombre de photos taguées (volume) : 0 / 28 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ???????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0012176036834716797 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.64540696144104 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592179 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592183 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592186 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592214 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592223 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592225 order by id desc limit 1 Qualite : 0.07691526813271601 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592231_08-10-2025_12_13_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592231 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592231 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08102025': {'nb_upload': 28, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1388143820, 1388143263, 1388143018, 1388142955, 1388141636, 1388141589, 1388141441, 1388141386, 1388141341, 1388139863, 1388139810, 1388139140, 1388139138, 1388139135, 1388139131, 1388138521, 1388138520, 1388138435, 1388138401, 1388138337, 1388138157, 1388138106, 1388138103, 1388136748, 1388136657, 1388136655, 1388136652, 1388136650] Looping around the photos to save general results len do output : 1 /27592231Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143820', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143263', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388143018', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388142955', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141636', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141589', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141441', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141386', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388141341', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139863', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139810', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139140', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139138', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139135', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388139131', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138521', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138520', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138435', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138401', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138337', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138157', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138106', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388138103', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136748', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136657', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136655', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136652', None, None, None, None, None, '3885195') ('3318', None, None, None, None, None, None, None, '3885195') ('3318', '27592231', '1388136650', None, None, None, None, None, '3885195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.06381750106811523 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.3037707805633545 time spend to save output : 0.06417727470397949 total time spend for step 10 : 5.367948055267334 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 28 set_done_treatment 83.95user 47.36system 3:11.41elapsed 68%CPU (0avgtext+0avgdata 2854064maxresident)k 2633904inputs+42592outputs (31204major+2513497minor)pagefaults 0swaps