python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 355986 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4192087'] with mtr_portfolio_ids : ['29234862'] and first list_photo_ids : [] new path : /proc/355986/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 2.2624566555023193 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Dec 5 19:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-05 19:40:34.959480: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-05 19:40:34.990542: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-05 19:40:34.992981: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f038c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-05 19:40:34.993029: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-05 19:40:34.997824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-05 19:40:35.322164: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x271ae250 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-05 19:40:35.322212: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-05 19:40:35.324089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-05 19:40:35.324753: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-05 19:40:35.335038: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-05 19:40:35.352730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-05 19:40:35.354448: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-05 19:40:35.385713: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-05 19:40:35.390405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-05 19:40:35.444044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-05 19:40:35.445816: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-05 19:40:35.446194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-05 19:40:35.447341: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-05 19:40:35.447362: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-05 19:40:35.447373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-05 19:40:35.449416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-05 19:40:35.767936: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-05 19:40:35.768007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-05 19:40:35.768022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-05 19:40:35.768036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-05 19:40:35.768049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-05 19:40:35.768061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-05 19:40:35.768074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-05 19:40:35.768087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-05 19:40:35.769276: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-05 19:40:35.770412: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-05 19:40:35.770441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-05 19:40:35.770456: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-05 19:40:35.770470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-05 19:40:35.770484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-05 19:40:35.770497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-05 19:40:35.770511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-05 19:40:35.770524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-05 19:40:35.771783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-05 19:40:35.771812: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-05 19:40:35.771820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-05 19:40:35.771827: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-05 19:40:35.773087: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-05 19:40:45.604186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-05 19:40:46.003253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 356548 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1956, 1134, 2106, 1242] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003306865692138672 nb_pixel_total : 9790 time to create 1 rle with old method : 0.01232147216796875 length of segment : 133 DEBUG bbox = [2082, 1578, 2148, 1734] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 7709 time to create 1 rle with old method : 0.008985757827758789 length of segment : 63 DEBUG bbox = [1980, 2520, 2148, 2718] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00042247772216796875 nb_pixel_total : 19537 time to create 1 rle with old method : 0.02285933494567871 length of segment : 169 DEBUG bbox = [1776, 738, 1986, 1056] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008194446563720703 nb_pixel_total : 36703 time to create 1 rle with old method : 0.04187440872192383 length of segment : 200 DEBUG bbox = [1464, 1380, 1656, 1632] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005881786346435547 nb_pixel_total : 36979 time to create 1 rle with old method : 0.05452847480773926 length of segment : 186 DEBUG bbox = [1452, 2574, 1614, 2724] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002505779266357422 nb_pixel_total : 14681 time to create 1 rle with old method : 0.016174793243408203 length of segment : 195 DEBUG bbox = [540, 1902, 696, 2232] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004341602325439453 nb_pixel_total : 29002 time to create 1 rle with old method : 0.03273916244506836 length of segment : 142 DEBUG bbox = [942, 2616, 1152, 2856] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 26947 time to create 1 rle with old method : 0.030774354934692383 length of segment : 184 DEBUG bbox = [1500, 2124, 1650, 2316] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00028443336486816406 nb_pixel_total : 16193 time to create 1 rle with old method : 0.018729686737060547 length of segment : 134 DEBUG bbox = [1488, 1158, 1680, 1380] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00038695335388183594 nb_pixel_total : 30127 time to create 1 rle with old method : 0.03443717956542969 length of segment : 189 DEBUG bbox = [1242, 1164, 1458, 1416] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004210472106933594 nb_pixel_total : 22701 time to create 1 rle with old method : 0.03818058967590332 length of segment : 221 DEBUG bbox = [48, 2124, 216, 2382] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005083084106445312 nb_pixel_total : 29381 time to create 1 rle with old method : 0.03776144981384277 length of segment : 159 DEBUG bbox = [240, 726, 390, 816] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00016880035400390625 nb_pixel_total : 8996 time to create 1 rle with old method : 0.010501623153686523 length of segment : 146 DEBUG bbox = [816, 1014, 1236, 1380] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016176700592041016 nb_pixel_total : 79277 time to create 1 rle with old method : 0.09780669212341309 length of segment : 406 DEBUG bbox = [228, 1260, 474, 1620] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007376670837402344 nb_pixel_total : 42028 time to create 1 rle with old method : 0.0468592643737793 length of segment : 228 DEBUG bbox = [222, 2658, 444, 2826] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00038361549377441406 nb_pixel_total : 24634 time to create 1 rle with old method : 0.027508974075317383 length of segment : 211 DEBUG bbox = [930, 2322, 1146, 2484] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00032329559326171875 nb_pixel_total : 16374 time to create 1 rle with old method : 0.020022153854370117 length of segment : 175 DEBUG bbox = [12, 3144, 144, 3312] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003504753112792969 nb_pixel_total : 17799 time to create 1 rle with old method : 0.020410537719726562 length of segment : 133 DEBUG bbox = [36, 0, 192, 162] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024509429931640625 nb_pixel_total : 17937 time to create 1 rle with old method : 0.02013397216796875 length of segment : 151 DEBUG bbox = [174, 1626, 426, 1812] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040459632873535156 nb_pixel_total : 21127 time to create 1 rle with old method : 0.0246124267578125 length of segment : 249 DEBUG bbox = [228, 534, 420, 654] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031280517578125 nb_pixel_total : 16533 time to create 1 rle with old method : 0.019132614135742188 length of segment : 184 DEBUG bbox = [150, 1830, 384, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005528926849365234 nb_pixel_total : 28829 time to create 1 rle with old method : 0.03416943550109863 length of segment : 225 DEBUG bbox = [984, 1728, 1206, 1944] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004582405090332031 nb_pixel_total : 23336 time to create 1 rle with old method : 0.028321027755737305 length of segment : 207 DEBUG bbox = [72, 18, 456, 306] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024213790893554688 nb_pixel_total : 75955 time to create 1 rle with old method : 0.09428787231445312 length of segment : 385 DEBUG bbox = [462, 798, 672, 930] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007226467132568359 nb_pixel_total : 18800 time to create 1 rle with old method : 0.022694826126098633 length of segment : 193 DEBUG bbox = [1050, 1470, 1494, 1836] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019388198852539062 nb_pixel_total : 88680 time to create 1 rle with old method : 0.11470842361450195 length of segment : 500 DEBUG bbox = [198, 714, 456, 996] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015292167663574219 nb_pixel_total : 32938 time to create 1 rle with old method : 0.046006202697753906 length of segment : 217 DEBUG bbox = [852, 2910, 1188, 3144] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016682147979736328 nb_pixel_total : 36459 time to create 1 rle with old method : 0.04468250274658203 length of segment : 375 DEBUG bbox = [162, 996, 390, 1152] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005772113800048828 nb_pixel_total : 14449 time to create 1 rle with old method : 0.01762986183166504 length of segment : 211 DEBUG bbox = [1092, 1026, 1656, 1554] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.006297588348388672 nb_pixel_total : 167983 time to create 1 rle with new method : 0.011758089065551758 length of segment : 574 DEBUG bbox = [342, 2652, 552, 2856] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009036064147949219 nb_pixel_total : 23258 time to create 1 rle with old method : 0.02780604362487793 length of segment : 200 DEBUG bbox = [1032, 3162, 1230, 3264] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005397796630859375 nb_pixel_total : 12516 time to create 1 rle with old method : 0.021607637405395508 length of segment : 177 DEBUG bbox = [870, 498, 1050, 708] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009152889251708984 nb_pixel_total : 18200 time to create 1 rle with old method : 0.02599644660949707 length of segment : 139 DEBUG bbox = [24, 1482, 360, 1692] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014107227325439453 nb_pixel_total : 35583 time to create 1 rle with old method : 0.042876243591308594 length of segment : 523 DEBUG bbox = [522, 2754, 630, 2868] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002560615539550781 nb_pixel_total : 5932 time to create 1 rle with old method : 0.00729823112487793 length of segment : 79 DEBUG bbox = [1362, 2658, 1536, 2910] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006775856018066406 nb_pixel_total : 26044 time to create 1 rle with old method : 0.031046628952026367 length of segment : 206 DEBUG bbox = [444, 2724, 660, 2868] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00054168701171875 nb_pixel_total : 18663 time to create 1 rle with old method : 0.020967721939086914 length of segment : 202 DEBUG bbox = [486, 2334, 600, 2460] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003025531768798828 nb_pixel_total : 8387 time to create 1 rle with old method : 0.009512186050415039 length of segment : 104 DEBUG bbox = [444, 84, 822, 366] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001346588134765625 nb_pixel_total : 33083 time to create 1 rle with old method : 0.038446664810180664 length of segment : 300 DEBUG bbox = [408, 3084, 570, 3192] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 9492 time to create 1 rle with old method : 0.01207590103149414 length of segment : 135 DEBUG bbox = [834, 3192, 1272, 3426] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017237663269042969 nb_pixel_total : 58173 time to create 1 rle with old method : 0.06758236885070801 length of segment : 407 DEBUG bbox = [1098, 1416, 1302, 1656] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006778240203857422 nb_pixel_total : 24966 time to create 1 rle with old method : 0.030314922332763672 length of segment : 187 DEBUG bbox = [1776, 1380, 2124, 1926] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0027992725372314453 nb_pixel_total : 122745 time to create 1 rle with old method : 0.14653754234313965 length of segment : 326 DEBUG bbox = [852, 1110, 1164, 1302] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010609626770019531 nb_pixel_total : 42629 time to create 1 rle with old method : 0.05092287063598633 length of segment : 281 DEBUG bbox = [1362, 2976, 1878, 3288] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002015829086303711 nb_pixel_total : 102334 time to create 1 rle with old method : 0.11278390884399414 length of segment : 474 DEBUG bbox = [834, 1122, 1158, 1308] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006604194641113281 nb_pixel_total : 44135 time to create 1 rle with old method : 0.05007576942443848 length of segment : 295 DEBUG bbox = [252, 156, 762, 432] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019063949584960938 nb_pixel_total : 76571 time to create 1 rle with old method : 0.08908200263977051 length of segment : 440 DEBUG bbox = [270, 3000, 582, 3240] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001201629638671875 nb_pixel_total : 40302 time to create 1 rle with old method : 0.04509615898132324 length of segment : 260 DEBUG bbox = [924, 1590, 1182, 1770] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008072853088378906 nb_pixel_total : 34579 time to create 1 rle with old method : 0.0385127067565918 length of segment : 227 DEBUG bbox = [54, 2058, 294, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008146762847900391 nb_pixel_total : 28184 time to create 1 rle with old method : 0.03152203559875488 length of segment : 219 DEBUG bbox = [1578, 1890, 1788, 2184] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001051187515258789 nb_pixel_total : 37332 time to create 1 rle with old method : 0.04091954231262207 length of segment : 197 DEBUG bbox = [636, 1914, 906, 2106] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009920597076416016 nb_pixel_total : 29542 time to create 1 rle with old method : 0.03348660469055176 length of segment : 265 DEBUG bbox = [1644, 888, 1818, 1014] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004775524139404297 nb_pixel_total : 11738 time to create 1 rle with old method : 0.013199329376220703 length of segment : 155 DEBUG bbox = [24, 1338, 336, 2064] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0033109188079833984 nb_pixel_total : 155626 time to create 1 rle with new method : 0.006622314453125 length of segment : 342 DEBUG bbox = [582, 3090, 834, 3318] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010082721710205078 nb_pixel_total : 31561 time to create 1 rle with old method : 0.036612510681152344 length of segment : 234 DEBUG bbox = [186, 2178, 504, 2454] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012416839599609375 nb_pixel_total : 53787 time to create 1 rle with old method : 0.06147122383117676 length of segment : 292 DEBUG bbox = [0, 30, 342, 210] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010640621185302734 nb_pixel_total : 26427 time to create 1 rle with old method : 0.029503822326660156 length of segment : 396 DEBUG bbox = [894, 1032, 1092, 1290] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009105205535888672 nb_pixel_total : 36064 time to create 1 rle with old method : 0.04083538055419922 length of segment : 191 DEBUG bbox = [1644, 2520, 1734, 2640] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003497600555419922 nb_pixel_total : 5607 time to create 1 rle with old method : 0.0066874027252197266 length of segment : 76 DEBUG bbox = [1542, 1902, 1788, 2202] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006570816040039062 nb_pixel_total : 38164 time to create 1 rle with old method : 0.04304695129394531 length of segment : 212 DEBUG bbox = [96, 1296, 360, 1446] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004124641418457031 nb_pixel_total : 25616 time to create 1 rle with old method : 0.027136802673339844 length of segment : 234 DEBUG bbox = [1308, 1284, 1536, 1488] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 21148 time to create 1 rle with old method : 0.024045705795288086 length of segment : 207 DEBUG bbox = [270, 2934, 552, 3084] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007874965667724609 nb_pixel_total : 22125 time to create 1 rle with old method : 0.02564072608947754 length of segment : 271 DEBUG bbox = [162, 3210, 318, 3330] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040721893310546875 nb_pixel_total : 11642 time to create 1 rle with old method : 0.01316380500793457 length of segment : 141 DEBUG bbox = [1626, 1452, 1818, 1590] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005905628204345703 nb_pixel_total : 21960 time to create 1 rle with old method : 0.025258779525756836 length of segment : 182 DEBUG bbox = [12, 3210, 138, 3372] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 9863 time to create 1 rle with old method : 0.011672258377075195 length of segment : 108 DEBUG bbox = [138, 3078, 516, 3294] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008771419525146484 nb_pixel_total : 31041 time to create 1 rle with old method : 0.03493523597717285 length of segment : 456 DEBUG bbox = [1740, 1560, 1902, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005164146423339844 nb_pixel_total : 11721 time to create 1 rle with old method : 0.013440847396850586 length of segment : 128 DEBUG bbox = [1668, 2556, 1842, 2724] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005118846893310547 nb_pixel_total : 12872 time to create 1 rle with old method : 0.014918327331542969 length of segment : 154 DEBUG bbox = [852, 2070, 1050, 2226] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005435943603515625 nb_pixel_total : 14959 time to create 1 rle with old method : 0.016587257385253906 length of segment : 190 DEBUG bbox = [1830, 576, 2148, 1068] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001916646957397461 nb_pixel_total : 107267 time to create 1 rle with old method : 0.11657500267028809 length of segment : 318 DEBUG bbox = [1218, 588, 1374, 726] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043272972106933594 nb_pixel_total : 13662 time to create 1 rle with old method : 0.01599717140197754 length of segment : 134 DEBUG bbox = [342, 2868, 444, 3048] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00032258033752441406 nb_pixel_total : 13488 time to create 1 rle with old method : 0.0157010555267334 length of segment : 96 DEBUG bbox = [1734, 1086, 2010, 1374] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013782978057861328 nb_pixel_total : 54753 time to create 1 rle with old method : 0.06241559982299805 length of segment : 257 DEBUG bbox = [516, 2664, 684, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005888938903808594 nb_pixel_total : 17856 time to create 1 rle with old method : 0.020853757858276367 length of segment : 166 DEBUG bbox = [6, 204, 180, 414] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 17695 time to create 1 rle with old method : 0.019924402236938477 length of segment : 153 DEBUG bbox = [300, 480, 468, 876] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000911712646484375 nb_pixel_total : 34880 time to create 1 rle with old method : 0.041063785552978516 length of segment : 158 DEBUG bbox = [6, 2178, 126, 2274] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00029730796813964844 nb_pixel_total : 6763 time to create 1 rle with old method : 0.008167505264282227 length of segment : 118 DEBUG bbox = [1938, 768, 2082, 966] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004520416259765625 nb_pixel_total : 17075 time to create 1 rle with old method : 0.019947528839111328 length of segment : 127 DEBUG bbox = [282, 684, 588, 1020] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013136863708496094 nb_pixel_total : 44472 time to create 1 rle with old method : 0.05053448677062988 length of segment : 389 DEBUG bbox = [1554, 1746, 1800, 1956] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 26645 time to create 1 rle with old method : 0.03058457374572754 length of segment : 246 DEBUG bbox = [126, 486, 396, 720] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008027553558349609 nb_pixel_total : 35329 time to create 1 rle with old method : 0.04039621353149414 length of segment : 254 DEBUG bbox = [1794, 1038, 1926, 1218] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004444122314453125 nb_pixel_total : 12197 time to create 1 rle with old method : 0.013960599899291992 length of segment : 122 DEBUG bbox = [1650, 1152, 1860, 1410] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 27786 time to create 1 rle with old method : 0.031191587448120117 length of segment : 197 DEBUG bbox = [1254, 1524, 1404, 1674] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045800209045410156 nb_pixel_total : 14197 time to create 1 rle with old method : 0.016678571701049805 length of segment : 127 DEBUG bbox = [1980, 684, 2136, 876] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005917549133300781 nb_pixel_total : 20727 time to create 1 rle with old method : 0.024062633514404297 length of segment : 149 DEBUG bbox = [1908, 936, 2016, 1062] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 8228 time to create 1 rle with old method : 0.009598016738891602 length of segment : 100 DEBUG bbox = [486, 354, 660, 474] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000514984130859375 nb_pixel_total : 14289 time to create 1 rle with old method : 0.020830869674682617 length of segment : 169 DEBUG bbox = [804, 696, 960, 864] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000621795654296875 nb_pixel_total : 12721 time to create 1 rle with old method : 0.021965742111206055 length of segment : 134 DEBUG bbox = [1338, 450, 1524, 582] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006926059722900391 nb_pixel_total : 14841 time to create 1 rle with old method : 0.01807427406311035 length of segment : 163 DEBUG bbox = [1506, 540, 1620, 732] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045013427734375 nb_pixel_total : 13821 time to create 1 rle with old method : 0.018800020217895508 length of segment : 109 DEBUG bbox = [2034, 1098, 2118, 1188] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000240325927734375 nb_pixel_total : 4823 time to create 1 rle with old method : 0.006012439727783203 length of segment : 78 DEBUG bbox = [1206, 1086, 1422, 1296] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00084686279296875 nb_pixel_total : 26561 time to create 1 rle with old method : 0.03377246856689453 length of segment : 202 DEBUG bbox = [1284, 960, 1446, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 19471 time to create 1 rle with old method : 0.02320694923400879 length of segment : 152 DEBUG bbox = [1980, 1872, 2142, 2070] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006394386291503906 nb_pixel_total : 23031 time to create 1 rle with old method : 0.028138160705566406 length of segment : 163 DEBUG bbox = [828, 1308, 1056, 1590] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008168220520019531 nb_pixel_total : 26811 time to create 1 rle with old method : 0.030767202377319336 length of segment : 191 DEBUG bbox = [1230, 1152, 1440, 1356] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008015632629394531 nb_pixel_total : 25617 time to create 1 rle with old method : 0.0428156852722168 length of segment : 208 DEBUG bbox = [1014, 426, 1254, 648] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007655620574951172 nb_pixel_total : 28634 time to create 1 rle with old method : 0.03302955627441406 length of segment : 223 DEBUG bbox = [1998, 2280, 2136, 2472] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 14355 time to create 1 rle with old method : 0.016773223876953125 length of segment : 132 time spent for convertir_results : 6.353717803955078 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 99 chid ids of type : 3594 Number RLEs to save : 21392 save missing photos in datou_result : time spend for datou_step_exec : 63.29867768287659 time spend to save output : 1.3943371772766113 total time spend for step 1 : 64.6930148601532 step2:crop_condition Fri Dec 5 19:41:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 99 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 3736932 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764960106_355986 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567524_0.png', 0, 101, 133, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567525_0.png', 0, 142, 61, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567527_0.png', 0, 310, 168, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567529_0.png', 0, 129, 157, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567530_0.png', 0, 304, 137, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567534_0.png', 0, 229, 187, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567536_0.png', 0, 79, 146, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567537_0.png', 0, 339, 406, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567541_0.png', 0, 157, 127, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567543_0.png', 0, 183, 247, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567545_0.png', 0, 313, 208, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567548_0.png', 0, 130, 189, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567549_0.png', 0, 350, 385, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567552_0.png', 0, 152, 209, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567553_0.png', 0, 498, 510, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567557_0.png', 0, 202, 307, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567559_0.png', 0, 237, 162, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567560_0.png', 0, 142, 198, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567562_0.png', 0, 250, 244, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567564_0.png', 0, 224, 407, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567569_0.png', 0, 184, 283, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567575_0.png', 0, 184, 265, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567576_0.png', 0, 123, 154, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567578_0.png', 0, 218, 234, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567580_0.png', 0, 176, 328, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567581_0.png', 0, 251, 186, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567582_0.png', 0, 117, 76, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567583_0.png', 0, 262, 210, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567584_0.png', 0, 141, 232, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567585_0.png', 0, 185, 207, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567586_0.png', 0, 142, 267, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567588_0.png', 0, 131, 180, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567589_0.png', 0, 151, 108, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567590_0.png', 0, 198, 370, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567591_0.png', 0, 217, 120, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567592_0.png', 0, 155, 154, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567597_0.png', 0, 287, 247, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567600_0.png', 0, 365, 142, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567602_0.png', 0, 195, 127, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567603_0.png', 0, 326, 274, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567604_0.png', 0, 188, 226, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567605_0.png', 0, 223, 253, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567606_0.png', 0, 171, 122, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567607_0.png', 0, 230, 184, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567609_0.png', 0, 184, 148, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567610_0.png', 0, 109, 98, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567611_0.png', 0, 113, 169, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567612_0.png', 0, 150, 134, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567614_0.png', 0, 159, 104, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567616_0.png', 0, 203, 201, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567619_0.png', 0, 220, 191, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567620_0.png', 0, 183, 208, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567621_0.png', 0, 214, 223, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960118), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567622_0.png', 0, 179, 132, 0, 1764960118,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 54 photos in the portfolio 3736932 time of upload the photos Elapsed time : 15.052540302276611 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764960125_355986 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567526_0.png', 0, 179, 167, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567531_0.png', 0, 213, 182, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567539_0.png', 0, 134, 211, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567540_0.png', 0, 127, 175, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567542_0.png', 0, 148, 149, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567544_0.png', 0, 109, 182, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567546_0.png', 0, 204, 207, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567551_0.png', 0, 228, 252, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567554_0.png', 0, 195, 170, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567555_0.png', 0, 92, 177, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567558_0.png', 0, 110, 78, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567561_0.png', 0, 100, 104, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567563_0.png', 0, 93, 128, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567565_0.png', 0, 221, 179, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567567_0.png', 0, 181, 277, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567573_0.png', 0, 184, 214, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567574_0.png', 0, 256, 197, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567579_0.png', 0, 257, 290, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567587_0.png', 0, 109, 130, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567593_0.png', 0, 151, 163, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567595_0.png', 0, 129, 134, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567596_0.png', 0, 161, 96, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567599_0.png', 0, 196, 152, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960130), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567618_0.png', 0, 190, 160, 0, 1764960130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.200170516967773 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764960134_355986 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960135), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567528_0.png', 0, 250, 186, 0, 1764960135,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960135), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567532_0.png', 0, 171, 132, 0, 1764960135,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960135), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567533_0.png', 0, 189, 189, 0, 1764960135,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960135), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567535_0.png', 0, 236, 154, 0, 1764960135,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960135), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567613_0.png', 0, 124, 157, 0, 1764960135,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960135), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567615_0.png', 0, 79, 78, 0, 1764960135,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9368536472320557 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764960141_355986 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567538_0.png', 0, 323, 197, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567547_0.png', 0, 282, 383, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567550_0.png', 0, 237, 201, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567566_0.png', 0, 514, 323, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567568_0.png', 0, 308, 474, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567570_0.png', 0, 225, 437, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567571_0.png', 0, 210, 260, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567577_0.png', 0, 610, 310, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567594_0.png', 0, 487, 306, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960143), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567601_0.png', 0, 81, 118, 0, 1764960143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.9444220066070557 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764960146_355986 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960147), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567556_0.png', 0, 176, 127, 0, 1764960147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960147), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567572_0.png', 0, 177, 215, 0, 1764960147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960147), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567598_0.png', 0, 178, 136, 0, 1764960147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960147), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567608_0.png', 0, 139, 127, 0, 1764960147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764960147), 0.0, 0.0, 14, '', 0, 0, '1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567617_0.png', 0, 155, 139, 0, 1764960147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.403984546661377 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1398112738, 1398112729, 1398112725, 1398112721, 1398112718, 1398112716, 1398112714, 1398112699, 1398112695, 1398112689, 1398112684, 1398112681] Looping around the photos to save general results len do output : 99 /1398120993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398120994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398120995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398120996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398120997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398120998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398120999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1398121105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112738', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112729', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112725', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112721', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112718', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112716', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112714', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112699', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112695', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112689', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112684', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112681', None, None, None, None, None, '4192087') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 309 time used for this insertion : 0.03536534309387207 save_final save missing photos in datou_result : time spend for datou_step_exec : 51.52633476257324 time spend to save output : 0.039244890213012695 total time spend for step 2 : 51.565579652786255 step3:rle_unique_nms_with_priority Fri Dec 5 19:42:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 99 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.741797685623169 time for calcul the mask position with numpy : 0.5726079940795898 nb_pixel_total : 8005654 time to create 1 rle with new method : 0.7929658889770508 time for calcul the mask position with numpy : 0.02379155158996582 nb_pixel_total : 8996 time to create 1 rle with old method : 0.010143280029296875 time for calcul the mask position with numpy : 0.023830652236938477 nb_pixel_total : 29381 time to create 1 rle with old method : 0.032593727111816406 time for calcul the mask position with numpy : 0.023803234100341797 nb_pixel_total : 22701 time to create 1 rle with old method : 0.023964405059814453 time for calcul the mask position with numpy : 0.022906064987182617 nb_pixel_total : 30127 time to create 1 rle with old method : 0.03343462944030762 time for calcul the mask position with numpy : 0.024448394775390625 nb_pixel_total : 16193 time to create 1 rle with old method : 0.018446922302246094 time for calcul the mask position with numpy : 0.023906469345092773 nb_pixel_total : 26947 time to create 1 rle with old method : 0.030582427978515625 time for calcul the mask position with numpy : 0.024593830108642578 nb_pixel_total : 29002 time to create 1 rle with old method : 0.03383469581604004 time for calcul the mask position with numpy : 0.02718663215637207 nb_pixel_total : 14681 time to create 1 rle with old method : 0.018502235412597656 time for calcul the mask position with numpy : 0.026106595993041992 nb_pixel_total : 36979 time to create 1 rle with old method : 0.04165244102478027 time for calcul the mask position with numpy : 0.025851011276245117 nb_pixel_total : 36703 time to create 1 rle with old method : 0.042397260665893555 time for calcul the mask position with numpy : 0.026381492614746094 nb_pixel_total : 19537 time to create 1 rle with old method : 0.022299766540527344 time for calcul the mask position with numpy : 0.02448129653930664 nb_pixel_total : 7709 time to create 1 rle with old method : 0.008619546890258789 time for calcul the mask position with numpy : 0.024470806121826172 nb_pixel_total : 9790 time to create 1 rle with old method : 0.011420965194702148 create new chi : 2.0526459217071533 time to delete rle : 0.02657318115234375 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6402 TO DO : save crop sub photo not yet done ! save time : 0.4419384002685547 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.837961435317993 time for calcul the mask position with numpy : 0.5830566883087158 nb_pixel_total : 8029862 time to create 1 rle with new method : 0.9088554382324219 time for calcul the mask position with numpy : 0.023540496826171875 nb_pixel_total : 28829 time to create 1 rle with old method : 0.03164935111999512 time for calcul the mask position with numpy : 0.022495508193969727 nb_pixel_total : 16533 time to create 1 rle with old method : 0.01739501953125 time for calcul the mask position with numpy : 0.023381471633911133 nb_pixel_total : 21127 time to create 1 rle with old method : 0.0231935977935791 time for calcul the mask position with numpy : 0.025302886962890625 nb_pixel_total : 17937 time to create 1 rle with old method : 0.01973891258239746 time for calcul the mask position with numpy : 0.023495912551879883 nb_pixel_total : 17799 time to create 1 rle with old method : 0.019674301147460938 time for calcul the mask position with numpy : 0.023334264755249023 nb_pixel_total : 16374 time to create 1 rle with old method : 0.017966747283935547 time for calcul the mask position with numpy : 0.024640798568725586 nb_pixel_total : 24634 time to create 1 rle with old method : 0.02681899070739746 time for calcul the mask position with numpy : 0.023709774017333984 nb_pixel_total : 42028 time to create 1 rle with old method : 0.045668601989746094 time for calcul the mask position with numpy : 0.0234982967376709 nb_pixel_total : 79277 time to create 1 rle with old method : 0.08299541473388672 create new chi : 2.031557559967041 time to delete rle : 0.00077056884765625 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 6084 TO DO : save crop sub photo not yet done ! save time : 0.43997645378112793 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 4.708064317703247 time for calcul the mask position with numpy : 0.5663418769836426 nb_pixel_total : 7740311 time to create 1 rle with new method : 0.8396153450012207 time for calcul the mask position with numpy : 0.022344112396240234 nb_pixel_total : 5932 time to create 1 rle with old method : 0.006376028060913086 time for calcul the mask position with numpy : 0.02263498306274414 nb_pixel_total : 35583 time to create 1 rle with old method : 0.037895917892456055 time for calcul the mask position with numpy : 0.0227205753326416 nb_pixel_total : 18200 time to create 1 rle with old method : 0.019224166870117188 time for calcul the mask position with numpy : 0.023491859436035156 nb_pixel_total : 12516 time to create 1 rle with old method : 0.013159513473510742 time for calcul the mask position with numpy : 0.02330636978149414 nb_pixel_total : 23258 time to create 1 rle with old method : 0.02429962158203125 time for calcul the mask position with numpy : 0.024077653884887695 nb_pixel_total : 167983 time to create 1 rle with new method : 0.6795856952667236 time for calcul the mask position with numpy : 0.023398637771606445 nb_pixel_total : 14449 time to create 1 rle with old method : 0.015412330627441406 time for calcul the mask position with numpy : 0.023581266403198242 nb_pixel_total : 36459 time to create 1 rle with old method : 0.03931593894958496 time for calcul the mask position with numpy : 0.02311396598815918 nb_pixel_total : 32938 time to create 1 rle with old method : 0.0350344181060791 time for calcul the mask position with numpy : 0.023563623428344727 nb_pixel_total : 88680 time to create 1 rle with old method : 0.09326553344726562 time for calcul the mask position with numpy : 0.0230715274810791 nb_pixel_total : 18800 time to create 1 rle with old method : 0.019736528396606445 time for calcul the mask position with numpy : 0.023738861083984375 nb_pixel_total : 75955 time to create 1 rle with old method : 0.08021020889282227 time for calcul the mask position with numpy : 0.023564815521240234 nb_pixel_total : 23336 time to create 1 rle with old method : 0.025002241134643555 create new chi : 2.859807014465332 time to delete rle : 0.0011138916015625 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9720 TO DO : save crop sub photo not yet done ! save time : 0.6811363697052002 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.157240629196167 time for calcul the mask position with numpy : 0.5431201457977295 nb_pixel_total : 8198731 time to create 1 rle with new method : 0.5732290744781494 time for calcul the mask position with numpy : 0.022921085357666016 nb_pixel_total : 9492 time to create 1 rle with old method : 0.010180234909057617 time for calcul the mask position with numpy : 0.021908044815063477 nb_pixel_total : 33083 time to create 1 rle with old method : 0.03471207618713379 time for calcul the mask position with numpy : 0.023509502410888672 nb_pixel_total : 8387 time to create 1 rle with old method : 0.00905156135559082 time for calcul the mask position with numpy : 0.023423433303833008 nb_pixel_total : 18663 time to create 1 rle with old method : 0.01993274688720703 time for calcul the mask position with numpy : 0.02322983741760254 nb_pixel_total : 26044 time to create 1 rle with old method : 0.02875828742980957 create new chi : 1.3736565113067627 time to delete rle : 0.00063323974609375 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4054 TO DO : save crop sub photo not yet done ! save time : 0.3111839294433594 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 3.348383665084839 time for calcul the mask position with numpy : 0.4592883586883545 nb_pixel_total : 7790243 time to create 1 rle with new method : 0.8005146980285645 time for calcul the mask position with numpy : 0.023597240447998047 nb_pixel_total : 34579 time to create 1 rle with old method : 0.05697822570800781 time for calcul the mask position with numpy : 0.02565741539001465 nb_pixel_total : 40302 time to create 1 rle with old method : 0.044486284255981445 time for calcul the mask position with numpy : 0.024115800857543945 nb_pixel_total : 76571 time to create 1 rle with old method : 0.08317446708679199 time for calcul the mask position with numpy : 0.02311396598815918 nb_pixel_total : 1858 time to create 1 rle with old method : 0.002277851104736328 time for calcul the mask position with numpy : 0.02479720115661621 nb_pixel_total : 102334 time to create 1 rle with old method : 0.12129545211791992 time for calcul the mask position with numpy : 0.027010440826416016 nb_pixel_total : 42629 time to create 1 rle with old method : 0.048468828201293945 time for calcul the mask position with numpy : 0.02503037452697754 nb_pixel_total : 122745 time to create 1 rle with old method : 0.13689398765563965 time for calcul the mask position with numpy : 0.02502608299255371 nb_pixel_total : 24966 time to create 1 rle with old method : 0.02820301055908203 time for calcul the mask position with numpy : 0.024471044540405273 nb_pixel_total : 58173 time to create 1 rle with old method : 0.06468439102172852 create new chi : 2.110206127166748 time to delete rle : 0.0011548995971679688 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 7717 TO DO : save crop sub photo not yet done ! save time : 0.5440518856048584 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.469726324081421 time for calcul the mask position with numpy : 0.7403354644775391 nb_pixel_total : 7851719 time to create 1 rle with new method : 0.8573336601257324 time for calcul the mask position with numpy : 0.023121356964111328 nb_pixel_total : 25616 time to create 1 rle with old method : 0.028374671936035156 time for calcul the mask position with numpy : 0.023628711700439453 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0015189647674560547 time for calcul the mask position with numpy : 0.02419590950012207 nb_pixel_total : 5607 time to create 1 rle with old method : 0.00648188591003418 time for calcul the mask position with numpy : 0.023697853088378906 nb_pixel_total : 36064 time to create 1 rle with old method : 0.040010929107666016 time for calcul the mask position with numpy : 0.024010181427001953 nb_pixel_total : 26427 time to create 1 rle with old method : 0.0296783447265625 time for calcul the mask position with numpy : 0.023926258087158203 nb_pixel_total : 53787 time to create 1 rle with old method : 0.05821728706359863 time for calcul the mask position with numpy : 0.023797035217285156 nb_pixel_total : 31561 time to create 1 rle with old method : 0.03546404838562012 time for calcul the mask position with numpy : 0.02355194091796875 nb_pixel_total : 155626 time to create 1 rle with new method : 0.572981595993042 time for calcul the mask position with numpy : 0.026273727416992188 nb_pixel_total : 11738 time to create 1 rle with old method : 0.01329660415649414 time for calcul the mask position with numpy : 0.025188684463500977 nb_pixel_total : 29542 time to create 1 rle with old method : 0.03270411491394043 time for calcul the mask position with numpy : 0.024827241897583008 nb_pixel_total : 37332 time to create 1 rle with old method : 0.041405677795410156 time for calcul the mask position with numpy : 0.024735689163208008 nb_pixel_total : 28184 time to create 1 rle with old method : 0.031025171279907227 create new chi : 2.8449957370758057 time to delete rle : 0.0010006427764892578 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7612 TO DO : save crop sub photo not yet done ! save time : 0.5397369861602783 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 2.821944236755371 time for calcul the mask position with numpy : 0.5884935855865479 nb_pixel_total : 8164900 time to create 1 rle with new method : 0.8594000339508057 time for calcul the mask position with numpy : 0.04162001609802246 nb_pixel_total : 11721 time to create 1 rle with old method : 0.019526243209838867 time for calcul the mask position with numpy : 0.028574466705322266 nb_pixel_total : 31041 time to create 1 rle with old method : 0.04162883758544922 time for calcul the mask position with numpy : 0.024089574813842773 nb_pixel_total : 9863 time to create 1 rle with old method : 0.011052131652832031 time for calcul the mask position with numpy : 0.023345947265625 nb_pixel_total : 21960 time to create 1 rle with old method : 0.024265527725219727 time for calcul the mask position with numpy : 0.02384042739868164 nb_pixel_total : 11642 time to create 1 rle with old method : 0.012973546981811523 time for calcul the mask position with numpy : 0.025017499923706055 nb_pixel_total : 22125 time to create 1 rle with old method : 0.0242919921875 time for calcul the mask position with numpy : 0.024809837341308594 nb_pixel_total : 21148 time to create 1 rle with old method : 0.02277064323425293 create new chi : 1.837907314300537 time to delete rle : 0.0008461475372314453 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 5146 TO DO : save crop sub photo not yet done ! save time : 0.37578368186950684 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.3026349544525146 time for calcul the mask position with numpy : 0.5532441139221191 nb_pixel_total : 8145640 time to create 1 rle with new method : 0.734032154083252 time for calcul the mask position with numpy : 0.035434722900390625 nb_pixel_total : 13662 time to create 1 rle with old method : 0.015039920806884766 time for calcul the mask position with numpy : 0.02356743812561035 nb_pixel_total : 107267 time to create 1 rle with old method : 0.12055516242980957 time for calcul the mask position with numpy : 0.026029586791992188 nb_pixel_total : 14959 time to create 1 rle with old method : 0.02161717414855957 time for calcul the mask position with numpy : 0.024154186248779297 nb_pixel_total : 12872 time to create 1 rle with old method : 0.014273643493652344 create new chi : 1.609379529953003 time to delete rle : 0.0005800724029541016 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3752 TO DO : save crop sub photo not yet done ! save time : 0.2905130386352539 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 3.3367087841033936 time for calcul the mask position with numpy : 0.6551997661590576 nb_pixel_total : 8148965 time to create 1 rle with new method : 0.731975793838501 time for calcul the mask position with numpy : 0.023426294326782227 nb_pixel_total : 6763 time to create 1 rle with old method : 0.007646083831787109 time for calcul the mask position with numpy : 0.024142980575561523 nb_pixel_total : 34880 time to create 1 rle with old method : 0.040439605712890625 time for calcul the mask position with numpy : 0.02755594253540039 nb_pixel_total : 17695 time to create 1 rle with old method : 0.029356002807617188 time for calcul the mask position with numpy : 0.027095794677734375 nb_pixel_total : 17856 time to create 1 rle with old method : 0.02203083038330078 time for calcul the mask position with numpy : 0.025007963180541992 nb_pixel_total : 54753 time to create 1 rle with old method : 0.08594965934753418 time for calcul the mask position with numpy : 0.025526046752929688 nb_pixel_total : 13488 time to create 1 rle with old method : 0.014699459075927734 create new chi : 1.7823302745819092 time to delete rle : 0.0007510185241699219 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 4056 TO DO : save crop sub photo not yet done ! save time : 0.3164215087890625 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 1.8247711658477783 time for calcul the mask position with numpy : 0.8376317024230957 nb_pixel_total : 8170879 time to create 1 rle with new method : 0.909599781036377 time for calcul the mask position with numpy : 0.0417630672454834 nb_pixel_total : 35329 time to create 1 rle with old method : 0.04028177261352539 time for calcul the mask position with numpy : 0.025252342224121094 nb_pixel_total : 26645 time to create 1 rle with old method : 0.030063867568969727 time for calcul the mask position with numpy : 0.024206876754760742 nb_pixel_total : 44472 time to create 1 rle with old method : 0.05024886131286621 time for calcul the mask position with numpy : 0.02636122703552246 nb_pixel_total : 17075 time to create 1 rle with old method : 0.019364118576049805 create new chi : 2.0476160049438477 time to delete rle : 0.0006241798400878906 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4192 TO DO : save crop sub photo not yet done ! save time : 0.31185173988342285 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.197408199310303 time for calcul the mask position with numpy : 0.5023689270019531 nb_pixel_total : 8104738 time to create 1 rle with new method : 0.750009298324585 time for calcul the mask position with numpy : 0.02328038215637207 nb_pixel_total : 19471 time to create 1 rle with old method : 0.021481037139892578 time for calcul the mask position with numpy : 0.023393630981445312 nb_pixel_total : 26561 time to create 1 rle with old method : 0.028610944747924805 time for calcul the mask position with numpy : 0.024361133575439453 nb_pixel_total : 4823 time to create 1 rle with old method : 0.005543947219848633 time for calcul the mask position with numpy : 0.02440500259399414 nb_pixel_total : 13821 time to create 1 rle with old method : 0.015363693237304688 time for calcul the mask position with numpy : 0.023372888565063477 nb_pixel_total : 14841 time to create 1 rle with old method : 0.016105175018310547 time for calcul the mask position with numpy : 0.024203062057495117 nb_pixel_total : 12721 time to create 1 rle with old method : 0.013839244842529297 time for calcul the mask position with numpy : 0.02294921875 nb_pixel_total : 14289 time to create 1 rle with old method : 0.015119552612304688 time for calcul the mask position with numpy : 0.023059368133544922 nb_pixel_total : 8228 time to create 1 rle with old method : 0.00866556167602539 time for calcul the mask position with numpy : 0.022662639617919922 nb_pixel_total : 20727 time to create 1 rle with old method : 0.022016048431396484 time for calcul the mask position with numpy : 0.023302078247070312 nb_pixel_total : 14197 time to create 1 rle with old method : 0.015093564987182617 time for calcul the mask position with numpy : 0.02376246452331543 nb_pixel_total : 27786 time to create 1 rle with old method : 0.0302884578704834 time for calcul the mask position with numpy : 0.02384471893310547 nb_pixel_total : 12197 time to create 1 rle with old method : 0.012863397598266602 create new chi : 1.782371997833252 time to delete rle : 0.0008387565612792969 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 5564 TO DO : save crop sub photo not yet done ! save time : 0.37973546981811523 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.250610113143921 time for calcul the mask position with numpy : 0.5923464298248291 nb_pixel_total : 8175952 time to create 1 rle with new method : 0.8405864238739014 time for calcul the mask position with numpy : 0.02284979820251465 nb_pixel_total : 14355 time to create 1 rle with old method : 0.01606464385986328 time for calcul the mask position with numpy : 0.02462172508239746 nb_pixel_total : 28634 time to create 1 rle with old method : 0.03188633918762207 time for calcul the mask position with numpy : 0.024068832397460938 nb_pixel_total : 25617 time to create 1 rle with old method : 0.027347564697265625 time for calcul the mask position with numpy : 0.02354121208190918 nb_pixel_total : 26811 time to create 1 rle with old method : 0.029692411422729492 time for calcul the mask position with numpy : 0.023381471633911133 nb_pixel_total : 23031 time to create 1 rle with old method : 0.02534627914428711 create new chi : 1.7228147983551025 time to delete rle : 0.0006618499755859375 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3994 TO DO : save crop sub photo not yet done ! save time : 0.30784058570861816 map_output_result : {1398112738: (0.0, 'Should be the crop_list due to order', 0), 1398112729: (0.0, 'Should be the crop_list due to order', 0), 1398112725: (0.0, 'Should be the crop_list due to order', 0), 1398112721: (0.0, 'Should be the crop_list due to order', 0), 1398112718: (0.0, 'Should be the crop_list due to order', 0), 1398112716: (0.0, 'Should be the crop_list due to order', 0), 1398112714: (0.0, 'Should be the crop_list due to order', 0), 1398112699: (0.0, 'Should be the crop_list due to order', 0), 1398112695: (0.0, 'Should be the crop_list due to order', 0), 1398112689: (0.0, 'Should be the crop_list due to order', 0), 1398112684: (0.0, 'Should be the crop_list due to order', 0), 1398112681: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1398112738, 1398112729, 1398112725, 1398112721, 1398112718, 1398112716, 1398112714, 1398112699, 1398112695, 1398112689, 1398112684, 1398112681] Looping around the photos to save general results len do output : 12 /1398112738.Didn't retrieve data . /1398112729.Didn't retrieve data . /1398112725.Didn't retrieve data . /1398112721.Didn't retrieve data . /1398112718.Didn't retrieve data . /1398112716.Didn't retrieve data . /1398112714.Didn't retrieve data . /1398112699.Didn't retrieve data . /1398112695.Didn't retrieve data . /1398112689.Didn't retrieve data . /1398112684.Didn't retrieve data . /1398112681.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112738', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112729', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112725', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112721', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112718', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112716', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112714', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112699', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112695', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112689', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112684', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112681', None, None, None, None, None, '4192087') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.022339582443237305 save_final save missing photos in datou_result : time spend for datou_step_exec : 71.4949779510498 time spend to save output : 0.02287435531616211 total time spend for step 3 : 71.51785230636597 step4:ventilate_hashtags_in_portfolio Fri Dec 5 19:43:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29234862 get user id for portfolio 29234862 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29234862 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_fonce','pehd','pet_clair','mal_croppe','environnement','flou','metal','background','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29234862 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_fonce','pehd','pet_clair','mal_croppe','environnement','flou','metal','background','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29234862 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_fonce','pehd','pet_clair','mal_croppe','environnement','flou','metal','background','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29235103,29235104,29235105,29235106,29235107,29235108,29235109,29235110,29235111,29235112,29235113?tags=papier,carton,pet_fonce,pehd,pet_clair,mal_croppe,environnement,flou,metal,background,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1398112738, 1398112729, 1398112725, 1398112721, 1398112718, 1398112716, 1398112714, 1398112699, 1398112695, 1398112689, 1398112684, 1398112681] Looping around the photos to save general results len do output : 1 /29234862. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112738', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112729', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112725', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112721', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112718', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112716', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112714', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112699', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112695', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112689', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112684', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112681', None, None, None, None, None, '4192087') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.017497777938842773 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.128258228302002 time spend to save output : 0.01776289939880371 total time spend for step 4 : 2.1460211277008057 step5:final Fri Dec 5 19:43:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1398112738: ('0.030193122267232517',), 1398112729: ('0.030193122267232517',), 1398112725: ('0.030193122267232517',), 1398112721: ('0.030193122267232517',), 1398112718: ('0.030193122267232517',), 1398112716: ('0.030193122267232517',), 1398112714: ('0.030193122267232517',), 1398112699: ('0.030193122267232517',), 1398112695: ('0.030193122267232517',), 1398112689: ('0.030193122267232517',), 1398112684: ('0.030193122267232517',), 1398112681: ('0.030193122267232517',)} new output for save of step final : {1398112738: ('0.030193122267232517',), 1398112729: ('0.030193122267232517',), 1398112725: ('0.030193122267232517',), 1398112721: ('0.030193122267232517',), 1398112718: ('0.030193122267232517',), 1398112716: ('0.030193122267232517',), 1398112714: ('0.030193122267232517',), 1398112699: ('0.030193122267232517',), 1398112695: ('0.030193122267232517',), 1398112689: ('0.030193122267232517',), 1398112684: ('0.030193122267232517',), 1398112681: ('0.030193122267232517',)} [1398112738, 1398112729, 1398112725, 1398112721, 1398112718, 1398112716, 1398112714, 1398112699, 1398112695, 1398112689, 1398112684, 1398112681] Looping around the photos to save general results len do output : 12 /1398112738.Didn't retrieve data . /1398112729.Didn't retrieve data . /1398112725.Didn't retrieve data . /1398112721.Didn't retrieve data . /1398112718.Didn't retrieve data . /1398112716.Didn't retrieve data . /1398112714.Didn't retrieve data . /1398112699.Didn't retrieve data . /1398112695.Didn't retrieve data . /1398112689.Didn't retrieve data . /1398112684.Didn't retrieve data . /1398112681.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112738', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112729', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112725', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112721', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112718', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112716', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112714', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112699', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112695', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112689', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112684', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112681', None, None, None, None, None, '4192087') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.0196382999420166 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1447157859802246 time spend to save output : 0.020218849182128906 total time spend for step 5 : 0.16493463516235352 step6:blur_detection Fri Dec 5 19:43:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79.jpg resize: (2160, 3840) 1398112738 -6.218544912104254 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb.jpg resize: (2160, 3840) 1398112729 -7.120305367839393 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c.jpg resize: (2160, 3840) 1398112725 -7.175192870644036 treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6.jpg resize: (2160, 3840) 1398112721 -7.123528360242745 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1.jpg resize: (2160, 3840) 1398112718 -7.222870967291883 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7.jpg resize: (2160, 3840) 1398112716 -7.08277308063941 treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63.jpg resize: (2160, 3840) 1398112714 -7.024808616563503 treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60.jpg resize: (2160, 3840) 1398112699 -7.157541504318495 treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9.jpg resize: (2160, 3840) 1398112695 -7.183538189042678 treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609.jpg resize: (2160, 3840) 1398112689 -6.470991893175816 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08.jpg resize: (2160, 3840) 1398112684 -3.762158426963852 treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688.jpg resize: (2160, 3840) 1398112681 -4.284731978931568 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567524_0.png resize: (133, 101) 1398120993 -4.472678640862519 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567525_0.png resize: (61, 142) 1398120994 -1.8669694619170407 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567527_0.png resize: (168, 310) 1398120995 -5.173846715989958 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567529_0.png resize: (157, 129) 1398120996 -4.631392877035413 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567530_0.png resize: (137, 304) 1398120997 -3.9417059665115 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567534_0.png resize: (187, 229) 1398120998 -4.0536938005567 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567536_0.png resize: (146, 79) 1398120999 -2.5090848794413456 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567537_0.png resize: (406, 339) 1398121000 -4.520703842549464 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567541_0.png resize: (127, 157) 1398121001 -1.925949248232623 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567543_0.png resize: (247, 183) 1398121002 -2.55976301869085 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567545_0.png resize: (208, 313) 1398121003 -3.8393402917070123 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567548_0.png resize: (189, 130) 1398121004 -3.5646539983818264 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567549_0.png resize: (385, 350) 1398121005 -4.420870165104043 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567552_0.png resize: (209, 152) 1398121006 -3.5243808967146664 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567553_0.png resize: (510, 498) 1398121007 -5.6324116367404296 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567557_0.png resize: (307, 202) 1398121008 -3.059398500609855 treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567559_0.png resize: (162, 237) 1398121009 -3.42671627452149 treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567560_0.png resize: (198, 142) 1398121010 -3.689385796225394 treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567562_0.png resize: (244, 250) 1398121011 -4.787182294170525 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567564_0.png resize: (407, 224) 1398121012 -3.8553247070587195 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567569_0.png resize: (283, 184) 1398121013 -4.94879716314992 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567575_0.png resize: (265, 184) 1398121014 -4.339768892406463 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567576_0.png resize: (154, 123) 1398121016 -4.389974156129714 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567578_0.png resize: (234, 218) 1398121017 -4.513323241144819 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567580_0.png resize: (328, 176) 1398121018 -3.2080334953858576 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567581_0.png resize: (186, 251) 1398121020 -4.233971569960864 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567582_0.png resize: (76, 117) 1398121021 -3.2985972354787787 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567583_0.png resize: (210, 262) 1398121023 -3.21508101674353 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567584_0.png resize: (232, 141) 1398121024 -3.785974557802327 treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567585_0.png resize: (207, 185) 1398121025 -3.7747640970818175 treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567586_0.png resize: (267, 142) 1398121026 -4.1917432976859805 treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567588_0.png resize: (180, 131) 1398121027 -2.790503756969561 treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567589_0.png resize: (108, 151) 1398121028 -0.19599525800504142 treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567590_0.png resize: (370, 198) 1398121029 -4.301295463182224 treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567591_0.png resize: (120, 217) 1398121030 -2.9263494089988042 treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567592_0.png resize: (154, 155) 1398121031 -3.6533640983773505 treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567597_0.png resize: (247, 287) 1398121032 -5.517591306182284 treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567600_0.png resize: (142, 365) 1398121033 -4.577080011751512 treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567602_0.png resize: (127, 195) 1398121034 -3.894618436664788 treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567603_0.png resize: (274, 326) 1398121035 -4.568299832948002 treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567604_0.png resize: (226, 188) 1398121036 -5.288491411765059 treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567605_0.png resize: (253, 223) 1398121037 -3.666380145647368 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567606_0.png resize: (122, 171) 1398121038 -4.665032279664789 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567607_0.png resize: (184, 230) 1398121039 -4.7373981277169825 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567609_0.png resize: (148, 184) 1398121040 -4.009596517998031 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567610_0.png resize: (98, 109) 1398121041 -4.995964073539229 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567611_0.png resize: (169, 113) 1398121042 -3.9214096260462656 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567612_0.png resize: (134, 150) 1398121043 -4.516980875811148 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567614_0.png resize: (104, 159) 1398121044 -2.6145110996519407 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567616_0.png resize: (201, 203) 1398121045 -4.668542675566032 treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567619_0.png resize: (191, 220) 1398121046 -2.5731065212040907 treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567620_0.png resize: (208, 183) 1398121048 -4.615739931176012 treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567621_0.png resize: (223, 214) 1398121049 -5.710508326483477 treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567622_0.png resize: (132, 179) 1398121050 -3.2915640804911392 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567526_0.png resize: (167, 179) 1398121056 -3.548560840750014 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567531_0.png resize: (182, 213) 1398121057 -4.57399608130716 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567539_0.png resize: (211, 134) 1398121058 -3.610416465493829 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567540_0.png resize: (175, 127) 1398121059 -3.823900070420433 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567542_0.png resize: (149, 148) 1398121060 -3.6285561307129965 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567544_0.png resize: (182, 109) 1398121061 -3.361633149330253 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567546_0.png resize: (207, 204) 1398121062 -2.9120281649308932 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567551_0.png resize: (252, 228) 1398121063 -4.453705058963931 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567554_0.png resize: (170, 195) 1398121064 -3.3469257327199418 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567555_0.png resize: (177, 92) 1398121065 -4.425155255635455 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567558_0.png resize: (78, 110) 1398121066 -3.461675113432571 treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567561_0.png resize: (104, 100) 1398121067 -1.1354018615164603 treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567563_0.png resize: (128, 93) 1398121068 -2.246695268246248 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567565_0.png resize: (179, 221) 1398121069 -3.7031592819750685 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567567_0.png resize: (277, 181) 1398121070 -4.9580807959424735 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567573_0.png resize: (214, 184) 1398121071 -3.622954515985599 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567574_0.png resize: (197, 256) 1398121072 -3.1120531677515584 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567579_0.png resize: (290, 257) 1398121073 -3.8888495339166744 treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567587_0.png resize: (130, 109) 1398121074 -3.2579228349971006 treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567593_0.png resize: (163, 151) 1398121075 -2.861249985661813 treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567595_0.png resize: (134, 129) 1398121076 -2.3375510532477572 treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567596_0.png resize: (96, 161) 1398121077 -3.941636507991992 treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567599_0.png resize: (152, 196) 1398121078 -3.3653022355356867 treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567618_0.png resize: (160, 190) 1398121079 -3.0704975545240787 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567528_0.png resize: (186, 250) 1398121081 -3.9054984219940483 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567532_0.png resize: (132, 171) 1398121082 -4.255448363874535 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567533_0.png resize: (189, 189) 1398121083 -4.6002391764183255 treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567535_0.png resize: (154, 236) 1398121084 -3.0860885254197545 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567613_0.png resize: (157, 124) 1398121085 -5.084164844403561 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567615_0.png resize: (78, 79) 1398121086 -4.583443304076274 treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567538_0.png resize: (197, 323) 1398121090 -4.256097784277403 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567547_0.png resize: (383, 282) 1398121091 -4.288456390947194 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567550_0.png resize: (201, 237) 1398121092 -4.947508969826472 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567566_0.png resize: (323, 514) 1398121094 -5.648551646662125 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567568_0.png resize: (474, 308) 1398121095 -4.747513999994618 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567570_0.png resize: (437, 225) 1398121096 -5.573710644686148 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567571_0.png resize: (260, 210) 1398121097 -5.111538888822458 treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567577_0.png resize: (310, 610) 1398121098 -4.648626447660862 treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567594_0.png resize: (306, 487) 1398121099 -5.445161101266811 treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567601_0.png resize: (118, 81) 1398121100 -3.797023911100862 treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567556_0.png resize: (127, 176) 1398121101 -3.672852917983716 treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567572_0.png resize: (215, 177) 1398121102 -4.221274153902902 treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567598_0.png resize: (136, 178) 1398121103 -2.1654987905345195 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567608_0.png resize: (127, 139) 1398121104 -3.9330277049240783 treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567617_0.png resize: (139, 155) 1398121105 -1.4799055533761953 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 111 time used for this insertion : 0.022849321365356445 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 111 time used for this insertion : 0.03795790672302246 save missing photos in datou_result : time spend for datou_step_exec : 45.84819316864014 time spend to save output : 0.06676125526428223 total time spend for step 6 : 45.91495442390442 step7:brightness Fri Dec 5 19:44:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79.jpg treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb.jpg treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c.jpg treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6.jpg treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1.jpg treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7.jpg treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63.jpg treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60.jpg treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9.jpg treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609.jpg treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08.jpg treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688.jpg treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567524_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567525_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567527_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567529_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567530_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567534_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567536_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567537_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567541_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567543_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567545_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567548_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567549_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567552_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567553_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567557_0.png treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567559_0.png treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567560_0.png treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567562_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567564_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567569_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567575_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567576_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567578_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567580_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567581_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567582_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567583_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567584_0.png treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567585_0.png treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567586_0.png treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567588_0.png treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567589_0.png treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567590_0.png treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567591_0.png treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567592_0.png treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567597_0.png treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567600_0.png treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567602_0.png treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567603_0.png treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567604_0.png treat image : temp/1764960028_355986_1398112689_2c7d7b0be39c565f7b6bd44c9a373609_rle_crop_4060567605_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567606_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567607_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567609_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567610_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567611_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567612_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567614_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567616_0.png treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567619_0.png treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567620_0.png treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567621_0.png treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567622_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567526_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567531_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567539_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567540_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567542_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567544_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567546_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567551_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567554_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567555_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567558_0.png treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567561_0.png treat image : temp/1764960028_355986_1398112721_b32c237b3f263cd57361b2a08c4b61c6_rle_crop_4060567563_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567565_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567567_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567573_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567574_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567579_0.png treat image : temp/1764960028_355986_1398112714_f1e6d3f9f39b642eb15c1c0e051c7e63_rle_crop_4060567587_0.png treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567593_0.png treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567595_0.png treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567596_0.png treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567599_0.png treat image : temp/1764960028_355986_1398112681_51658a88828f13d512f9025690490688_rle_crop_4060567618_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567528_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567532_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567533_0.png treat image : temp/1764960028_355986_1398112738_c0e6770e7180df7f805a734aeeab9f79_rle_crop_4060567535_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567613_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567615_0.png treat image : temp/1764960028_355986_1398112729_e3d3372c7458a66e16e9e8d6198feeeb_rle_crop_4060567538_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567547_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567550_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567566_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567568_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567570_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567571_0.png treat image : temp/1764960028_355986_1398112716_461ef5da39b10c74f8cf123914be39f7_rle_crop_4060567577_0.png treat image : temp/1764960028_355986_1398112699_3809215c92e2fe8273aa623497420b60_rle_crop_4060567594_0.png treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567601_0.png treat image : temp/1764960028_355986_1398112725_d64fd32f1315f6e2d9b943197a6c6e9c_rle_crop_4060567556_0.png treat image : temp/1764960028_355986_1398112718_37bce93682cfca89a40f0a3c2ca188b1_rle_crop_4060567572_0.png treat image : temp/1764960028_355986_1398112695_b832a51391e7b1a29b2d0573745ed5c9_rle_crop_4060567598_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567608_0.png treat image : temp/1764960028_355986_1398112684_f8b8a2860f34abd64217ebf018169a08_rle_crop_4060567617_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 111 time used for this insertion : 0.023919105529785156 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 111 time used for this insertion : 0.04009199142456055 save missing photos in datou_result : time spend for datou_step_exec : 12.154311418533325 time spend to save output : 0.07025361061096191 total time spend for step 7 : 12.224565029144287 step8:velours_tree Fri Dec 5 19:44:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08063864707946777 time spend to save output : 5.555152893066406e-05 total time spend for step 8 : 0.08069419860839844 step9:send_mail_cod Fri Dec 5 19:44:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29234862_05-12-2025_19_44_39.pdf 29235103 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette292351031764960279 29235104 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette292351041764960281 29235105 imagette292351051764960282 29235106 imagette292351061764960282 29235107 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette292351071764960283 29235108 imagette292351081764960284 29235110 imagette292351101764960284 29235111 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette292351111764960284 29235112 imagette292351121764960284 29235113 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette292351131764960284 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29234862 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29235103,29235104,29235105,29235106,29235107,29235108,29235109,29235110,29235111,29235112,29235113?tags=papier,carton,pet_fonce,pehd,pet_clair,mal_croppe,environnement,flou,metal,background,autre your option no_mail is active, we will not send the real mail to your client args[1398112738] : ((1398112738, -6.218544912104254, 492609224), (1398112738, -0.5088527468152121, 501862349), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112729] : ((1398112729, -7.120305367839393, 492609224), (1398112729, 0.026386028854002888, 2107752395), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112725] : ((1398112725, -7.175192870644036, 492609224), (1398112725, 0.04080129223476607, 2107752395), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112721] : ((1398112721, -7.123528360242745, 492609224), (1398112721, 0.011161405315493077, 2107752395), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112718] : ((1398112718, -7.222870967291883, 492609224), (1398112718, 0.06297868825750866, 2107752395), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112716] : ((1398112716, -7.08277308063941, 492609224), (1398112716, -0.06855343302376223, 2107752395), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112714] : ((1398112714, -7.024808616563503, 492609224), (1398112714, -0.04468513592412883, 2107752395), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112699] : ((1398112699, -7.157541504318495, 492609224), (1398112699, -0.05771377523965022, 2107752395), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112695] : ((1398112695, -7.183538189042678, 492609224), (1398112695, -0.0888727937640565, 496442774), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112689] : ((1398112689, -6.470991893175816, 492609224), (1398112689, -0.7326225715547783, 501862349), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112684] : ((1398112684, -3.762158426963852, 492609224), (1398112684, -2.4308309312160765, 501862349), '0.030193122267232517') We are sending mail with results at report@fotonower.com args[1398112681] : ((1398112681, -4.284731978931568, 492609224), (1398112681, -2.1811985456372263, 501862349), '0.030193122267232517') We are sending mail with results at report@fotonower.com refus_total : 0.030193122267232517 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29234862 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29234862_05-12-2025_19_44_39.pdf results_Auto_P29234862_05-12-2025_19_44_39.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29234862_05-12-2025_19_44_39.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29234862','results_Auto_P29234862_05-12-2025_19_44_39.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29234862_05-12-2025_19_44_39.pdf','pdf','','0.61','0.030193122267232517') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1398112738, 1398112729, 1398112725, 1398112721, 1398112718, 1398112716, 1398112714, 1398112699, 1398112695, 1398112689, 1398112684, 1398112681] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112738', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112729', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112725', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112721', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112718', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112716', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112714', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112699', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112695', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112689', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112684', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112681', None, None, None, None, None, '4192087') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01782512664794922 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.340169668197632 time spend to save output : 0.018075227737426758 total time spend for step 9 : 8.358244895935059 step10:split_time_score Fri Dec 5 19:44:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05122025 29234862 Nombre de photos uploadées : 12 / 23040 (0%) 05122025 29234862 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 05122025 29234862 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005993843078613281 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2518768310546875 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.02024720883663846 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29215829_05-12-2025_07_18_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29215829 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29215829 AND mptpi.`type`=3726 To do Qualite : 0.08062623735825346 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29218856_05-12-2025_09_08_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29218856 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29218856 AND mptpi.`type`=3726 To do Qualite : 0.03431425314422106 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29218860_05-12-2025_09_06_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29218860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29218860 AND mptpi.`type`=3726 To do Qualite : 0.0440857790340672 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29218862_05-12-2025_09_05_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29218862 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29218862 AND mptpi.`type`=3726 To do Qualite : 0.013129256345713169 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29227479_05-12-2025_15_16_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29227479 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29227479 AND mptpi.`type`=3726 To do Qualite : 0.03396382359924027 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29229821_05-12-2025_16_44_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29229821 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29229821 AND mptpi.`type`=3594 To do Qualite : 0.030193122267232517 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29234862_05-12-2025_19_44_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29234862 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29234862 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05122025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1398112738, 1398112729, 1398112725, 1398112721, 1398112718, 1398112716, 1398112714, 1398112699, 1398112695, 1398112689, 1398112684, 1398112681] Looping around the photos to save general results len do output : 1 /29234862Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112738', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112729', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112725', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112721', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112718', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112716', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112714', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112699', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112695', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112689', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112684', None, None, None, None, None, '4192087') ('3318', None, None, None, None, None, None, None, '4192087') ('3318', '29234862', '1398112681', None, None, None, None, None, '4192087') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.017948150634765625 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.9606502056121826 time spend to save output : 0.01818394660949707 total time spend for step 10 : 0.9788341522216797 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 111.94user 108.46system 4:22.55elapsed 83%CPU (0avgtext+0avgdata 4996264maxresident)k 1982840inputs+87392outputs (7366major+12205944minor)pagefaults 0swaps