python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3295735 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4066373'] with mtr_portfolio_ids : ['28657587'] and first list_photo_ids : [] new path : /proc/3295735/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 26 ; length of list_pids : 26 ; length of list_args : 26 time to download the photos : 3.5322461128234863 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Nov 18 12:50:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4359 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-18 12:50:34.412037: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-18 12:50:34.438414: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-18 12:50:34.440884: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe89c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-18 12:50:34.440945: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-18 12:50:34.444894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-18 12:50:34.732213: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1101f1e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-18 12:50:34.732285: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-18 12:50:34.733600: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-18 12:50:34.734533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-18 12:50:34.745108: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-18 12:50:34.750679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-18 12:50:34.752239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-18 12:50:34.760925: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-18 12:50:34.762668: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-18 12:50:34.771068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-18 12:50:34.772529: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-18 12:50:34.772652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-18 12:50:34.773503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-18 12:50:34.773523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-18 12:50:34.773535: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-18 12:50:34.774794: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3907 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-18 12:50:35.100524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-18 12:50:35.100656: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-18 12:50:35.100682: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-18 12:50:35.100701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-18 12:50:35.100720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-18 12:50:35.100738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-18 12:50:35.100758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-18 12:50:35.100779: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-18 12:50:35.102030: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-18 12:50:35.103610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-18 12:50:35.103699: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-18 12:50:35.103719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-18 12:50:35.103737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-18 12:50:35.103753: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-18 12:50:35.103770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-18 12:50:35.103784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-18 12:50:35.103799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-18 12:50:35.104765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-18 12:50:35.104804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-18 12:50:35.104814: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-18 12:50:35.104822: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-18 12:50:35.105849: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3907 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-18 12:50:43.765519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-18 12:50:43.984832: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-18 12:50:45.678374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.514773: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-11-18 12:50:46.589691: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.589789: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.591031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.591065: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.598599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.598635: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.599703: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.599718: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.647721: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.647766: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.648418: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.648433: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.649073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.649088: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.649717: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.649732: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.657618: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.657639: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.658287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.658304: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 12:50:46.674720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.675595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.676450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.677404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.681593: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.682290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.682976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.683657: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.684683: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.684699: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-11-18 12:50:46.694890: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.695533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.704531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.705170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.705830: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.706564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.707251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 12:50:46.707930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3561881600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 26 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 Detection mask done ! Trying to reset tf kernel 3296351 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2367 tf kernel not reseted sub process len(results) : 26 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 26 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3166 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0002911090850830078 nb_pixel_total : 3297 time to create 1 rle with old method : 0.005409717559814453 length of segment : 59 time for calcul the mask position with numpy : 0.0002970695495605469 nb_pixel_total : 6455 time to create 1 rle with old method : 0.01005101203918457 length of segment : 137 time for calcul the mask position with numpy : 0.0006077289581298828 nb_pixel_total : 14828 time to create 1 rle with old method : 0.022849559783935547 length of segment : 366 time for calcul the mask position with numpy : 0.00033164024353027344 nb_pixel_total : 8364 time to create 1 rle with old method : 0.01228642463684082 length of segment : 201 time for calcul the mask position with numpy : 0.00017261505126953125 nb_pixel_total : 2367 time to create 1 rle with old method : 0.003825664520263672 length of segment : 64 time for calcul the mask position with numpy : 0.00022983551025390625 nb_pixel_total : 6446 time to create 1 rle with old method : 0.009382009506225586 length of segment : 117 time for calcul the mask position with numpy : 0.0004191398620605469 nb_pixel_total : 14994 time to create 1 rle with old method : 0.021367788314819336 length of segment : 142 time for calcul the mask position with numpy : 0.00019860267639160156 nb_pixel_total : 3515 time to create 1 rle with old method : 0.005312919616699219 length of segment : 88 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 8272 time to create 1 rle with old method : 0.012193918228149414 length of segment : 117 time for calcul the mask position with numpy : 0.0002837181091308594 nb_pixel_total : 6388 time to create 1 rle with old method : 0.00994729995727539 length of segment : 76 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 7837 time to create 1 rle with old method : 0.012116670608520508 length of segment : 125 time for calcul the mask position with numpy : 0.0002887248992919922 nb_pixel_total : 7323 time to create 1 rle with old method : 0.010816335678100586 length of segment : 97 time for calcul the mask position with numpy : 0.0002872943878173828 nb_pixel_total : 7737 time to create 1 rle with old method : 0.01125335693359375 length of segment : 101 time for calcul the mask position with numpy : 0.0007555484771728516 nb_pixel_total : 23351 time to create 1 rle with old method : 0.03360581398010254 length of segment : 204 time for calcul the mask position with numpy : 0.0004458427429199219 nb_pixel_total : 14351 time to create 1 rle with old method : 0.02103900909423828 length of segment : 173 time for calcul the mask position with numpy : 0.0007979869842529297 nb_pixel_total : 24857 time to create 1 rle with old method : 0.03797197341918945 length of segment : 224 time for calcul the mask position with numpy : 0.00021409988403320312 nb_pixel_total : 5477 time to create 1 rle with old method : 0.007158756256103516 length of segment : 92 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 6453 time to create 1 rle with old method : 0.00970005989074707 length of segment : 115 time for calcul the mask position with numpy : 0.0003795623779296875 nb_pixel_total : 11127 time to create 1 rle with old method : 0.016054630279541016 length of segment : 150 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 6261 time to create 1 rle with old method : 0.00852823257446289 length of segment : 86 time for calcul the mask position with numpy : 0.000194549560546875 nb_pixel_total : 5743 time to create 1 rle with old method : 0.00761723518371582 length of segment : 116 time for calcul the mask position with numpy : 0.0005984306335449219 nb_pixel_total : 12515 time to create 1 rle with old method : 0.015824556350708008 length of segment : 197 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 7971 time to create 1 rle with old method : 0.010040283203125 length of segment : 87 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 5290 time to create 1 rle with old method : 0.006516218185424805 length of segment : 91 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 2165 time to create 1 rle with old method : 0.002863168716430664 length of segment : 32 time for calcul the mask position with numpy : 0.0002739429473876953 nb_pixel_total : 9666 time to create 1 rle with old method : 0.01202535629272461 length of segment : 109 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 6248 time to create 1 rle with old method : 0.007962465286254883 length of segment : 82 time for calcul the mask position with numpy : 0.0021402835845947266 nb_pixel_total : 109819 time to create 1 rle with old method : 0.1301867961883545 length of segment : 519 time for calcul the mask position with numpy : 0.00030159950256347656 nb_pixel_total : 8578 time to create 1 rle with old method : 0.010879278182983398 length of segment : 124 time for calcul the mask position with numpy : 0.0002295970916748047 nb_pixel_total : 8829 time to create 1 rle with old method : 0.011511087417602539 length of segment : 139 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 12281 time to create 1 rle with old method : 0.016945600509643555 length of segment : 127 time for calcul the mask position with numpy : 0.00034427642822265625 nb_pixel_total : 14393 time to create 1 rle with old method : 0.017626285552978516 length of segment : 129 time for calcul the mask position with numpy : 0.00017499923706054688 nb_pixel_total : 7089 time to create 1 rle with old method : 0.00861358642578125 length of segment : 62 time for calcul the mask position with numpy : 0.0003399848937988281 nb_pixel_total : 15181 time to create 1 rle with old method : 0.017779827117919922 length of segment : 157 time for calcul the mask position with numpy : 0.00021982192993164062 nb_pixel_total : 9424 time to create 1 rle with old method : 0.010691165924072266 length of segment : 129 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 6248 time to create 1 rle with old method : 0.007197141647338867 length of segment : 69 time for calcul the mask position with numpy : 0.00014019012451171875 nb_pixel_total : 7625 time to create 1 rle with old method : 0.008455753326416016 length of segment : 129 time for calcul the mask position with numpy : 0.0004317760467529297 nb_pixel_total : 27389 time to create 1 rle with old method : 0.03037405014038086 length of segment : 227 time for calcul the mask position with numpy : 0.0001876354217529297 nb_pixel_total : 10090 time to create 1 rle with old method : 0.011361122131347656 length of segment : 92 time for calcul the mask position with numpy : 0.0001506805419921875 nb_pixel_total : 5311 time to create 1 rle with old method : 0.006437540054321289 length of segment : 108 time for calcul the mask position with numpy : 0.0001926422119140625 nb_pixel_total : 9157 time to create 1 rle with old method : 0.010607004165649414 length of segment : 98 time for calcul the mask position with numpy : 0.00011396408081054688 nb_pixel_total : 4418 time to create 1 rle with old method : 0.005114316940307617 length of segment : 85 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 3267 time to create 1 rle with old method : 0.003907442092895508 length of segment : 53 time for calcul the mask position with numpy : 0.0002472400665283203 nb_pixel_total : 13813 time to create 1 rle with old method : 0.015814542770385742 length of segment : 171 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 6011 time to create 1 rle with old method : 0.007120847702026367 length of segment : 64 time for calcul the mask position with numpy : 0.0016181468963623047 nb_pixel_total : 108997 time to create 1 rle with old method : 0.12359452247619629 length of segment : 583 time for calcul the mask position with numpy : 0.0002601146697998047 nb_pixel_total : 9065 time to create 1 rle with old method : 0.010313987731933594 length of segment : 175 time for calcul the mask position with numpy : 0.0028052330017089844 nb_pixel_total : 77497 time to create 1 rle with old method : 0.08602643013000488 length of segment : 323 time for calcul the mask position with numpy : 0.00030040740966796875 nb_pixel_total : 13529 time to create 1 rle with old method : 0.015326499938964844 length of segment : 152 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 3181 time to create 1 rle with old method : 0.0037131309509277344 length of segment : 55 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 6861 time to create 1 rle with old method : 0.007911205291748047 length of segment : 87 time for calcul the mask position with numpy : 0.06867742538452148 nb_pixel_total : 1570541 time to create 1 rle with new method : 0.10469913482666016 length of segment : 1253 time for calcul the mask position with numpy : 0.00019168853759765625 nb_pixel_total : 5968 time to create 1 rle with old method : 0.007402181625366211 length of segment : 106 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 4696 time to create 1 rle with old method : 0.006460905075073242 length of segment : 107 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 3208 time to create 1 rle with old method : 0.0047206878662109375 length of segment : 76 time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 14391 time to create 1 rle with old method : 0.017183542251586914 length of segment : 127 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 7510 time to create 1 rle with old method : 0.014405012130737305 length of segment : 128 time for calcul the mask position with numpy : 0.00023555755615234375 nb_pixel_total : 12015 time to create 1 rle with old method : 0.014122962951660156 length of segment : 84 time for calcul the mask position with numpy : 0.00017380714416503906 nb_pixel_total : 9456 time to create 1 rle with old method : 0.010848045349121094 length of segment : 86 time for calcul the mask position with numpy : 0.00022792816162109375 nb_pixel_total : 10161 time to create 1 rle with old method : 0.012253046035766602 length of segment : 97 time for calcul the mask position with numpy : 0.0001842975616455078 nb_pixel_total : 8946 time to create 1 rle with old method : 0.01023244857788086 length of segment : 162 time for calcul the mask position with numpy : 0.0002300739288330078 nb_pixel_total : 11619 time to create 1 rle with old method : 0.013218164443969727 length of segment : 128 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 4917 time to create 1 rle with old method : 0.005753993988037109 length of segment : 86 time for calcul the mask position with numpy : 0.00033593177795410156 nb_pixel_total : 4203 time to create 1 rle with old method : 0.005113363265991211 length of segment : 121 time for calcul the mask position with numpy : 0.0004811286926269531 nb_pixel_total : 16441 time to create 1 rle with old method : 0.018967151641845703 length of segment : 218 time for calcul the mask position with numpy : 0.0004699230194091797 nb_pixel_total : 9230 time to create 1 rle with old method : 0.011580228805541992 length of segment : 152 time for calcul the mask position with numpy : 0.024263620376586914 nb_pixel_total : 794616 time to create 1 rle with new method : 0.022118568420410156 length of segment : 1062 time for calcul the mask position with numpy : 0.0003724098205566406 nb_pixel_total : 12458 time to create 1 rle with old method : 0.0159151554107666 length of segment : 136 time for calcul the mask position with numpy : 0.00021338462829589844 nb_pixel_total : 5939 time to create 1 rle with old method : 0.007491111755371094 length of segment : 83 time for calcul the mask position with numpy : 0.0007722377777099609 nb_pixel_total : 22203 time to create 1 rle with old method : 0.026415109634399414 length of segment : 213 time for calcul the mask position with numpy : 0.00018358230590820312 nb_pixel_total : 8316 time to create 1 rle with old method : 0.009567737579345703 length of segment : 98 time for calcul the mask position with numpy : 0.00028204917907714844 nb_pixel_total : 6328 time to create 1 rle with old method : 0.007781505584716797 length of segment : 158 time for calcul the mask position with numpy : 0.0002586841583251953 nb_pixel_total : 4310 time to create 1 rle with old method : 0.005105733871459961 length of segment : 92 time for calcul the mask position with numpy : 0.012794017791748047 nb_pixel_total : 848933 time to create 1 rle with new method : 0.017099380493164062 length of segment : 1245 time for calcul the mask position with numpy : 0.00026607513427734375 nb_pixel_total : 4687 time to create 1 rle with old method : 0.00576019287109375 length of segment : 142 time for calcul the mask position with numpy : 0.0006749629974365234 nb_pixel_total : 29014 time to create 1 rle with old method : 0.03421139717102051 length of segment : 181 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 4797 time to create 1 rle with old method : 0.006244182586669922 length of segment : 152 time for calcul the mask position with numpy : 0.0011222362518310547 nb_pixel_total : 36068 time to create 1 rle with old method : 0.04220223426818848 length of segment : 321 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 3072 time to create 1 rle with old method : 0.0038149356842041016 length of segment : 82 time for calcul the mask position with numpy : 0.00023031234741210938 nb_pixel_total : 4497 time to create 1 rle with old method : 0.005449533462524414 length of segment : 92 time for calcul the mask position with numpy : 0.000911712646484375 nb_pixel_total : 22190 time to create 1 rle with old method : 0.026177167892456055 length of segment : 328 time spent for convertir_results : 3.961886167526245 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 81 chid ids of type : 3594 Number RLEs to save : 14621 save missing photos in datou_result : time spend for datou_step_exec : 39.14446973800659 time spend to save output : 0.9507277011871338 total time spend for step 1 : 40.095197439193726 step2:crop_condition Tue Nov 18 12:51:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 26 ! batch 1 Loaded 81 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! About to upload 50 photos upload in portfolio : 3736932 init cache_photo without model_param we have 50 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763466674_3295735 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031888_d94575672ffbe692481a14d090a07186_rle_crop_4037586102_0.png', 0, 86, 59, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031888_d94575672ffbe692481a14d090a07186_rle_crop_4037586103_0.png', 0, 116, 137, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586104_0.png', 0, 234, 191, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586105_0.png', 0, 85, 173, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586106_0.png', 0, 68, 64, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586107_0.png', 0, 99, 117, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586108_0.png', 0, 168, 137, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586109_0.png', 0, 51, 88, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586110_0.png', 0, 123, 95, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586111_0.png', 0, 132, 61, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586112_0.png', 0, 87, 124, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586113_0.png', 0, 123, 97, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586114_0.png', 0, 115, 101, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586118_0.png', 0, 98, 92, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586119_0.png', 0, 99, 114, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031832_5112c25a9c67415c5a8d9f778633cb6d_rle_crop_4037586121_0.png', 0, 149, 86, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031832_5112c25a9c67415c5a8d9f778633cb6d_rle_crop_4037586122_0.png', 0, 102, 116, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586124_0.png', 0, 190, 87, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586125_0.png', 0, 67, 88, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586127_0.png', 0, 128, 109, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031823_9019355e7ff84f9c699d6ca9d188ba04_rle_crop_4037586128_0.png', 0, 123, 81, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586130_0.png', 0, 134, 124, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586133_0.png', 0, 175, 129, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586136_0.png', 0, 130, 122, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586138_0.png', 0, 76, 128, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586141_0.png', 0, 60, 106, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586142_0.png', 0, 135, 97, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031408_cefde63c62eaa0156ac93e674fe23ab1_rle_crop_4037586143_0.png', 0, 71, 82, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031408_cefde63c62eaa0156ac93e674fe23ab1_rle_crop_4037586144_0.png', 0, 111, 44, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586151_0.png', 0, 69, 53, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586154_0.png', 0, 81, 106, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586155_0.png', 0, 104, 90, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586156_0.png', 0, 59, 76, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586157_0.png', 0, 148, 125, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586158_0.png', 0, 70, 128, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031329_ac39dc66fc64680f50bf208f8443867d_rle_crop_4037586159_0.png', 0, 179, 82, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031316_4cc52d51b23b8e81f5f28b0ce21e0d31_rle_crop_4037586163_0.png', 0, 150, 125, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031316_4cc52d51b23b8e81f5f28b0ce21e0d31_rle_crop_4037586164_0.png', 0, 86, 80, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031314_42e40edd33c43f3244e149bf991f53c7_rle_crop_4037586165_0.png', 0, 69, 119, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031311_c1316042d6653cf850d589775164e81d_rle_crop_4037586167_0.png', 0, 119, 152, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586169_0.png', 0, 148, 134, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586171_0.png', 0, 252, 181, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586172_0.png', 0, 139, 83, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586173_0.png', 0, 67, 158, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586174_0.png', 0, 86, 92, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031293_7c85130eeb86aaba453b93d07c17a48a_rle_crop_4037586176_0.png', 0, 99, 141, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586178_0.png', 0, 76, 126, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586180_0.png', 0, 52, 82, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031286_0b33223f8a7af9556397d23bd18e6a86_rle_crop_4037586181_0.png', 0, 73, 87, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466683), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031286_0b33223f8a7af9556397d23bd18e6a86_rle_crop_4037586182_0.png', 0, 140, 328, 0, 1763466683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 50 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.797745943069458 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763466687_3295735 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466687), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586147_0.png', 0, 354, 530, 0, 1763466687,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.509629487991333 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763466688_3295735 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466688), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586126_0.png', 0, 86, 32, 0, 1763466688,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466688), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586134_0.png', 0, 141, 62, 0, 1763466688,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466688), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586152_0.png', 0, 99, 87, 0, 1763466688,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0536186695098877 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763466704_3295735 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586115_0.png', 0, 169, 204, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586116_0.png', 0, 113, 173, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586117_0.png', 0, 220, 189, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586120_0.png', 0, 133, 150, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586129_0.png', 0, 341, 516, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586131_0.png', 0, 85, 136, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586135_0.png', 0, 230, 111, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586137_0.png', 0, 127, 67, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586139_0.png', 0, 156, 226, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586140_0.png', 0, 141, 92, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586145_0.png', 0, 115, 171, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586148_0.png', 0, 91, 144, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586149_0.png', 0, 480, 312, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586150_0.png', 0, 128, 152, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586153_0.png', 0, 1636, 1017, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031321_4f37233700d76e0598612e5c410cc0f9_rle_crop_4037586160_0.png', 0, 131, 86, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031321_4f37233700d76e0598612e5c410cc0f9_rle_crop_4037586161_0.png', 0, 191, 95, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031319_6de2ac0db2fa899f19e144f8b2b49186_rle_crop_4037586162_0.png', 0, 90, 151, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031314_42e40edd33c43f3244e149bf991f53c7_rle_crop_4037586166_0.png', 0, 136, 177, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031311_c1316042d6653cf850d589775164e81d_rle_crop_4037586168_0.png', 0, 1135, 996, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586170_0.png', 0, 98, 83, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586175_0.png', 0, 957, 1022, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586177_0.png', 0, 230, 167, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466709), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586179_0.png', 0, 162, 321, 0, 1763466709,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.52664589881897 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763466712_3295735 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466712), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586123_0.png', 0, 93, 175, 0, 1763466712,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466712), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586132_0.png', 0, 114, 127, 0, 1763466712,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763466712), 0.0, 0.0, 14, '', 0, 0, '1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586146_0.png', 0, 125, 64, 0, 1763466712,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0007400512695312 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1395031888, 1395031878, 1395031873, 1395031867, 1395031832, 1395031829, 1395031823, 1395031817, 1395031477, 1395031448, 1395031408, 1395031385, 1395031381, 1395031379, 1395031329, 1395031321, 1395031319, 1395031316, 1395031314, 1395031311, 1395031301, 1395031298, 1395031296, 1395031293, 1395031288, 1395031286] Looping around the photos to save general results len do output : 81 /1395042470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395042566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031888', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031878', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031873', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031867', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031832', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031829', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031823', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031817', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031477', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031448', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031408', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031385', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031381', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031379', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031329', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031321', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031319', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031316', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031314', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031311', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031301', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031298', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031296', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031293', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031288', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031286', None, None, None, None, None, '4066373') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 269 time used for this insertion : 0.05040693283081055 save_final save missing photos in datou_result : time spend for datou_step_exec : 41.17574858665466 time spend to save output : 0.05414891242980957 total time spend for step 2 : 41.22989749908447 step3:rle_unique_nms_with_priority Tue Nov 18 12:51:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 81 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.11535239219665527 time for calcul the mask position with numpy : 0.29897618293762207 nb_pixel_total : 2063848 time to create 1 rle with new method : 0.09584426879882812 time for calcul the mask position with numpy : 0.006841421127319336 nb_pixel_total : 6455 time to create 1 rle with old method : 0.007618904113769531 time for calcul the mask position with numpy : 0.0060770511627197266 nb_pixel_total : 3297 time to create 1 rle with old method : 0.0038688182830810547 create new chi : 0.4230997562408447 time to delete rle : 0.020745277404785156 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1472 TO DO : save crop sub photo not yet done ! save time : 0.12569284439086914 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.06931161880493164 time for calcul the mask position with numpy : 0.04514360427856445 nb_pixel_total : 2044341 time to create 1 rle with new method : 0.0851433277130127 time for calcul the mask position with numpy : 0.006735801696777344 nb_pixel_total : 4389 time to create 1 rle with old method : 0.005339860916137695 time for calcul the mask position with numpy : 0.0063779354095458984 nb_pixel_total : 2367 time to create 1 rle with old method : 0.0028226375579833984 time for calcul the mask position with numpy : 0.006348848342895508 nb_pixel_total : 7675 time to create 1 rle with old method : 0.008993864059448242 time for calcul the mask position with numpy : 0.00633692741394043 nb_pixel_total : 14828 time to create 1 rle with old method : 0.017714977264404297 create new chi : 0.20339536666870117 time to delete rle : 0.00041031837463378906 batch 1 Loaded 9 chid ids of type : 3594 ++++++++++++Number RLEs to save : 2404 TO DO : save crop sub photo not yet done ! save time : 0.1866447925567627 nb_obj : 5 nb_hashtags : 1 time to prepare the origin masks : 0.11874628067016602 time for calcul the mask position with numpy : 0.27272725105285645 nb_pixel_total : 2032594 time to create 1 rle with new method : 0.1479954719543457 time for calcul the mask position with numpy : 0.0063631534576416016 nb_pixel_total : 7837 time to create 1 rle with old method : 0.009630680084228516 time for calcul the mask position with numpy : 0.006237506866455078 nb_pixel_total : 6388 time to create 1 rle with old method : 0.0076406002044677734 time for calcul the mask position with numpy : 0.006208181381225586 nb_pixel_total : 8272 time to create 1 rle with old method : 0.009746789932250977 time for calcul the mask position with numpy : 0.006319761276245117 nb_pixel_total : 3515 time to create 1 rle with old method : 0.004159212112426758 time for calcul the mask position with numpy : 0.0066950321197509766 nb_pixel_total : 14994 time to create 1 rle with old method : 0.017537832260131836 create new chi : 0.512082576751709 time to delete rle : 0.00039005279541015625 batch 1 Loaded 11 chid ids of type : 3594 ++++++++++Number RLEs to save : 2176 TO DO : save crop sub photo not yet done ! save time : 0.16262340545654297 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.582322359085083 time for calcul the mask position with numpy : 0.0774235725402832 nb_pixel_total : 1972924 time to create 1 rle with new method : 0.1790480613708496 time for calcul the mask position with numpy : 0.006950855255126953 nb_pixel_total : 11127 time to create 1 rle with old method : 0.013337373733520508 time for calcul the mask position with numpy : 0.006687164306640625 nb_pixel_total : 6453 time to create 1 rle with old method : 0.007986068725585938 time for calcul the mask position with numpy : 0.007044315338134766 nb_pixel_total : 5477 time to create 1 rle with old method : 0.006949663162231445 time for calcul the mask position with numpy : 0.007349252700805664 nb_pixel_total : 24857 time to create 1 rle with old method : 0.029862403869628906 time for calcul the mask position with numpy : 0.007453441619873047 nb_pixel_total : 14351 time to create 1 rle with old method : 0.01689457893371582 time for calcul the mask position with numpy : 0.0065228939056396484 nb_pixel_total : 23351 time to create 1 rle with old method : 0.02729344367980957 time for calcul the mask position with numpy : 0.006612539291381836 nb_pixel_total : 7737 time to create 1 rle with old method : 0.009596586227416992 time for calcul the mask position with numpy : 0.0073282718658447266 nb_pixel_total : 7323 time to create 1 rle with old method : 0.009267807006835938 create new chi : 0.44545793533325195 time to delete rle : 0.0006663799285888672 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 3392 TO DO : save crop sub photo not yet done ! save time : 0.23607301712036133 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05166482925415039 time for calcul the mask position with numpy : 0.022693395614624023 nb_pixel_total : 2061596 time to create 1 rle with new method : 0.03267812728881836 time for calcul the mask position with numpy : 0.006789684295654297 nb_pixel_total : 5743 time to create 1 rle with old method : 0.00683903694152832 time for calcul the mask position with numpy : 0.007100105285644531 nb_pixel_total : 6261 time to create 1 rle with old method : 0.007546901702880859 create new chi : 0.090972900390625 time to delete rle : 0.0002636909484863281 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1484 TO DO : save crop sub photo not yet done ! save time : 0.12910747528076172 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.1678144931793213 time for calcul the mask position with numpy : 0.2996234893798828 nb_pixel_total : 2035993 time to create 1 rle with new method : 0.2676990032196045 time for calcul the mask position with numpy : 0.006433963775634766 nb_pixel_total : 9666 time to create 1 rle with old method : 0.011764764785766602 time for calcul the mask position with numpy : 0.006414175033569336 nb_pixel_total : 2165 time to create 1 rle with old method : 0.002507925033569336 time for calcul the mask position with numpy : 0.006247758865356445 nb_pixel_total : 5290 time to create 1 rle with old method : 0.006262540817260742 time for calcul the mask position with numpy : 0.0064830780029296875 nb_pixel_total : 7971 time to create 1 rle with old method : 0.009569644927978516 time for calcul the mask position with numpy : 0.006738901138305664 nb_pixel_total : 12515 time to create 1 rle with old method : 0.01505589485168457 create new chi : 0.6552374362945557 time to delete rle : 0.0003876686096191406 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2112 TO DO : save crop sub photo not yet done ! save time : 0.16956496238708496 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03804326057434082 time for calcul the mask position with numpy : 0.02181553840637207 nb_pixel_total : 2067352 time to create 1 rle with new method : 0.03140568733215332 time for calcul the mask position with numpy : 0.006660938262939453 nb_pixel_total : 6248 time to create 1 rle with old method : 0.007418155670166016 create new chi : 0.0745391845703125 time to delete rle : 0.00023055076599121094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1244 TO DO : save crop sub photo not yet done ! save time : 0.12491393089294434 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.08387041091918945 time for calcul the mask position with numpy : 0.0601046085357666 nb_pixel_total : 1946374 time to create 1 rle with new method : 0.24656200408935547 time for calcul the mask position with numpy : 0.00643467903137207 nb_pixel_total : 8829 time to create 1 rle with old method : 0.010401725769042969 time for calcul the mask position with numpy : 0.006333112716674805 nb_pixel_total : 8578 time to create 1 rle with old method : 0.010389566421508789 time for calcul the mask position with numpy : 0.007215738296508789 nb_pixel_total : 109819 time to create 1 rle with old method : 0.12915635108947754 create new chi : 0.4879891872406006 time to delete rle : 0.0005071163177490234 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2644 TO DO : save crop sub photo not yet done ! save time : 0.2203977108001709 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.46791696548461914 time for calcul the mask position with numpy : 0.08408474922180176 nb_pixel_total : 2008984 time to create 1 rle with new method : 0.3976285457611084 time for calcul the mask position with numpy : 0.006467342376708984 nb_pixel_total : 6248 time to create 1 rle with old method : 0.007267475128173828 time for calcul the mask position with numpy : 0.006474733352661133 nb_pixel_total : 9424 time to create 1 rle with old method : 0.011180877685546875 time for calcul the mask position with numpy : 0.006798744201660156 nb_pixel_total : 15181 time to create 1 rle with old method : 0.01788806915283203 time for calcul the mask position with numpy : 0.0064868927001953125 nb_pixel_total : 7089 time to create 1 rle with old method : 0.008390426635742188 time for calcul the mask position with numpy : 0.0066449642181396484 nb_pixel_total : 14393 time to create 1 rle with old method : 0.016753196716308594 time for calcul the mask position with numpy : 0.006562232971191406 nb_pixel_total : 12281 time to create 1 rle with old method : 0.014551877975463867 create new chi : 0.6075739860534668 time to delete rle : 0.0005524158477783203 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 2426 TO DO : save crop sub photo not yet done ! save time : 0.2086801528930664 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.07449173927307129 time for calcul the mask position with numpy : 0.021790504455566406 nb_pixel_total : 2014028 time to create 1 rle with new method : 0.08240890502929688 time for calcul the mask position with numpy : 0.006428956985473633 nb_pixel_total : 9157 time to create 1 rle with old method : 0.01082754135131836 time for calcul the mask position with numpy : 0.006069183349609375 nb_pixel_total : 5311 time to create 1 rle with old method : 0.006320953369140625 time for calcul the mask position with numpy : 0.006084918975830078 nb_pixel_total : 10090 time to create 1 rle with old method : 0.011911630630493164 time for calcul the mask position with numpy : 0.006167888641357422 nb_pixel_total : 27389 time to create 1 rle with old method : 0.032080888748168945 time for calcul the mask position with numpy : 0.0062367916107177734 nb_pixel_total : 7625 time to create 1 rle with old method : 0.008996963500976562 create new chi : 0.21270537376403809 time to delete rle : 0.00040435791015625 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2388 TO DO : save crop sub photo not yet done ! save time : 0.21094560623168945 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.053501129150390625 time for calcul the mask position with numpy : 0.16426801681518555 nb_pixel_total : 2065915 time to create 1 rle with new method : 0.0819709300994873 time for calcul the mask position with numpy : 0.006117582321166992 nb_pixel_total : 3267 time to create 1 rle with old method : 0.003849029541015625 time for calcul the mask position with numpy : 0.005831718444824219 nb_pixel_total : 4418 time to create 1 rle with old method : 0.0049970149993896484 create new chi : 0.27724599838256836 time to delete rle : 0.0002472400665283203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1356 TO DO : save crop sub photo not yet done ! save time : 0.1223456859588623 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.5432283878326416 time for calcul the mask position with numpy : 0.15709424018859863 nb_pixel_total : 1935714 time to create 1 rle with new method : 0.16003870964050293 time for calcul the mask position with numpy : 0.007630825042724609 nb_pixel_total : 9065 time to create 1 rle with old method : 0.01125645637512207 time for calcul the mask position with numpy : 0.008232831954956055 nb_pixel_total : 108997 time to create 1 rle with old method : 0.14593958854675293 time for calcul the mask position with numpy : 0.00769352912902832 nb_pixel_total : 6011 time to create 1 rle with old method : 0.007157325744628906 time for calcul the mask position with numpy : 0.007453441619873047 nb_pixel_total : 13813 time to create 1 rle with old method : 0.01639080047607422 create new chi : 0.5423545837402344 time to delete rle : 0.000644683837890625 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3066 TO DO : save crop sub photo not yet done ! save time : 0.22715139389038086 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.14841485023498535 time for calcul the mask position with numpy : 0.010426521301269531 nb_pixel_total : 488149 time to create 1 rle with new method : 0.16440320014953613 time for calcul the mask position with numpy : 0.006384849548339844 nb_pixel_total : 2370 time to create 1 rle with old method : 0.0028345584869384766 time for calcul the mask position with numpy : 0.049898386001586914 nb_pixel_total : 1482013 time to create 1 rle with new method : 0.19772553443908691 time for calcul the mask position with numpy : 0.006439924240112305 nb_pixel_total : 6861 time to create 1 rle with old method : 0.00821542739868164 time for calcul the mask position with numpy : 0.006224870681762695 nb_pixel_total : 3181 time to create 1 rle with old method : 0.0038764476776123047 time for calcul the mask position with numpy : 0.006415128707885742 nb_pixel_total : 13529 time to create 1 rle with old method : 0.015824556350708008 time for calcul the mask position with numpy : 0.006779193878173828 nb_pixel_total : 77497 time to create 1 rle with old method : 0.09150552749633789 create new chi : 0.593513011932373 time to delete rle : 0.0008549690246582031 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 4860 TO DO : save crop sub photo not yet done ! save time : 0.31101226806640625 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.0655660629272461 time for calcul the mask position with numpy : 0.020513534545898438 nb_pixel_total : 2043795 time to create 1 rle with new method : 0.2799553871154785 time for calcul the mask position with numpy : 0.007148265838623047 nb_pixel_total : 7510 time to create 1 rle with old method : 0.008858680725097656 time for calcul the mask position with numpy : 0.006765842437744141 nb_pixel_total : 14391 time to create 1 rle with old method : 0.016809940338134766 time for calcul the mask position with numpy : 0.006411552429199219 nb_pixel_total : 3208 time to create 1 rle with old method : 0.0037910938262939453 time for calcul the mask position with numpy : 0.006169795989990234 nb_pixel_total : 4696 time to create 1 rle with old method : 0.005601167678833008 create new chi : 0.36243557929992676 time to delete rle : 0.0003807544708251953 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 1956 TO DO : save crop sub photo not yet done ! save time : 0.1527116298675537 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05011320114135742 time for calcul the mask position with numpy : 0.1462852954864502 nb_pixel_total : 2061585 time to create 1 rle with new method : 0.09932661056518555 time for calcul the mask position with numpy : 0.007566690444946289 nb_pixel_total : 12015 time to create 1 rle with old method : 0.013950109481811523 create new chi : 0.27730464935302734 time to delete rle : 0.0003707408905029297 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1248 TO DO : save crop sub photo not yet done ! save time : 0.17613935470581055 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0465395450592041 time for calcul the mask position with numpy : 0.08825087547302246 nb_pixel_total : 2053983 time to create 1 rle with new method : 0.09262895584106445 time for calcul the mask position with numpy : 0.01186990737915039 nb_pixel_total : 10161 time to create 1 rle with old method : 0.01188206672668457 time for calcul the mask position with numpy : 0.011342763900756836 nb_pixel_total : 9456 time to create 1 rle with old method : 0.011053323745727539 create new chi : 0.23757266998291016 time to delete rle : 0.00033545494079589844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1446 TO DO : save crop sub photo not yet done ! save time : 0.11674165725708008 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.08582210540771484 time for calcul the mask position with numpy : 0.12343502044677734 nb_pixel_total : 2064654 time to create 1 rle with new method : 0.09050536155700684 time for calcul the mask position with numpy : 0.006301164627075195 nb_pixel_total : 8946 time to create 1 rle with old method : 0.010472774505615234 create new chi : 0.23983335494995117 time to delete rle : 0.0002574920654296875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1404 TO DO : save crop sub photo not yet done ! save time : 0.12291264533996582 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04459214210510254 time for calcul the mask position with numpy : 0.09131455421447754 nb_pixel_total : 2057064 time to create 1 rle with new method : 0.24572300910949707 time for calcul the mask position with numpy : 0.00693058967590332 nb_pixel_total : 4917 time to create 1 rle with old method : 0.005763530731201172 time for calcul the mask position with numpy : 0.006522178649902344 nb_pixel_total : 11619 time to create 1 rle with old method : 0.013213872909545898 create new chi : 0.380709171295166 time to delete rle : 0.00031256675720214844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1508 TO DO : save crop sub photo not yet done ! save time : 0.135941743850708 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.13318490982055664 time for calcul the mask position with numpy : 0.07100105285644531 nb_pixel_total : 2052956 time to create 1 rle with new method : 0.23946690559387207 time for calcul the mask position with numpy : 0.007028818130493164 nb_pixel_total : 16441 time to create 1 rle with old method : 0.01939702033996582 time for calcul the mask position with numpy : 0.006861686706542969 nb_pixel_total : 4203 time to create 1 rle with old method : 0.005164384841918945 create new chi : 0.3609609603881836 time to delete rle : 0.000385284423828125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1758 TO DO : save crop sub photo not yet done ! save time : 0.1426708698272705 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.048790693283081055 time for calcul the mask position with numpy : 0.053151845932006836 nb_pixel_total : 1269754 time to create 1 rle with new method : 0.08055639266967773 time for calcul the mask position with numpy : 0.011182546615600586 nb_pixel_total : 794616 time to create 1 rle with new method : 0.3174309730529785 time for calcul the mask position with numpy : 0.005999326705932617 nb_pixel_total : 9230 time to create 1 rle with old method : 0.010299921035766602 create new chi : 0.48776721954345703 time to delete rle : 0.0005316734313964844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3508 TO DO : save crop sub photo not yet done ! save time : 0.2580106258392334 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.2976644039154053 time for calcul the mask position with numpy : 0.2356581687927246 nb_pixel_total : 2024684 time to create 1 rle with new method : 0.10146331787109375 time for calcul the mask position with numpy : 0.006706714630126953 nb_pixel_total : 8316 time to create 1 rle with old method : 0.010097503662109375 time for calcul the mask position with numpy : 0.0069048404693603516 nb_pixel_total : 22203 time to create 1 rle with old method : 0.025434494018554688 time for calcul the mask position with numpy : 0.006932258605957031 nb_pixel_total : 5939 time to create 1 rle with old method : 0.006993293762207031 time for calcul the mask position with numpy : 0.006388664245605469 nb_pixel_total : 12458 time to create 1 rle with old method : 0.01464390754699707 create new chi : 0.43218278884887695 time to delete rle : 0.0004210472106933594 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 2140 TO DO : save crop sub photo not yet done ! save time : 0.1759953498840332 No data in photo_id : 1395031298 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06868982315063477 time for calcul the mask position with numpy : 0.018528461456298828 nb_pixel_total : 1219357 time to create 1 rle with new method : 0.1856234073638916 time for calcul the mask position with numpy : 0.013164520263671875 nb_pixel_total : 843605 time to create 1 rle with new method : 0.21736454963684082 time for calcul the mask position with numpy : 0.006334781646728516 nb_pixel_total : 4310 time to create 1 rle with old method : 0.0051116943359375 time for calcul the mask position with numpy : 0.006159067153930664 nb_pixel_total : 6328 time to create 1 rle with old method : 0.007473468780517578 create new chi : 0.46793603897094727 time to delete rle : 0.001026153564453125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4067 TO DO : save crop sub photo not yet done ! save time : 0.2841782569885254 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04597330093383789 time for calcul the mask position with numpy : 0.35297131538391113 nb_pixel_total : 2068913 time to create 1 rle with new method : 0.48673582077026367 time for calcul the mask position with numpy : 0.007113933563232422 nb_pixel_total : 4687 time to create 1 rle with old method : 0.00784444808959961 create new chi : 0.8595044612884521 time to delete rle : 0.0003266334533691406 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1364 TO DO : save crop sub photo not yet done ! save time : 0.12952280044555664 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07411503791809082 time for calcul the mask position with numpy : 0.2765958309173584 nb_pixel_total : 2000649 time to create 1 rle with new method : 0.3175318241119385 time for calcul the mask position with numpy : 0.007896900177001953 nb_pixel_total : 3072 time to create 1 rle with old method : 0.004778385162353516 time for calcul the mask position with numpy : 0.00668787956237793 nb_pixel_total : 36068 time to create 1 rle with old method : 0.043540239334106445 time for calcul the mask position with numpy : 0.006527423858642578 nb_pixel_total : 4797 time to create 1 rle with old method : 0.006880283355712891 time for calcul the mask position with numpy : 0.006968259811401367 nb_pixel_total : 29014 time to create 1 rle with old method : 0.036257266998291016 create new chi : 0.7247910499572754 time to delete rle : 0.0004906654357910156 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2552 TO DO : save crop sub photo not yet done ! save time : 0.1948080062866211 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04861569404602051 time for calcul the mask position with numpy : 0.02123570442199707 nb_pixel_total : 2046913 time to create 1 rle with new method : 0.126861572265625 time for calcul the mask position with numpy : 0.006437540054321289 nb_pixel_total : 22190 time to create 1 rle with old method : 0.026235580444335938 time for calcul the mask position with numpy : 0.0064585208892822266 nb_pixel_total : 4497 time to create 1 rle with old method : 0.005289316177368164 create new chi : 0.20035099983215332 time to delete rle : 0.0003757476806640625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1920 TO DO : save crop sub photo not yet done ! save time : 0.15515494346618652 map_output_result : {1395031888: (0.0, 'Should be the crop_list due to order', 0), 1395031878: (0.0, 'Should be the crop_list due to order', 0), 1395031873: (0.0, 'Should be the crop_list due to order', 0), 1395031867: (0.0, 'Should be the crop_list due to order', 0), 1395031832: (0.0, 'Should be the crop_list due to order', 0), 1395031829: (0.0, 'Should be the crop_list due to order', 0), 1395031823: (0.0, 'Should be the crop_list due to order', 0), 1395031817: (0.0, 'Should be the crop_list due to order', 0), 1395031477: (0.0, 'Should be the crop_list due to order', 0), 1395031448: (0.0, 'Should be the crop_list due to order', 0), 1395031408: (0.0, 'Should be the crop_list due to order', 0), 1395031385: (0.0, 'Should be the crop_list due to order', 0), 1395031381: (0.0, 'Should be the crop_list due to order', 0), 1395031379: (0.0, 'Should be the crop_list due to order', 0), 1395031329: (0.0, 'Should be the crop_list due to order', 0), 1395031321: (0.0, 'Should be the crop_list due to order', 0), 1395031319: (0.0, 'Should be the crop_list due to order', 0), 1395031316: (0.0, 'Should be the crop_list due to order', 0), 1395031314: (0.0, 'Should be the crop_list due to order', 0), 1395031311: (0.0, 'Should be the crop_list due to order', 0), 1395031301: (0.0, 'Should be the crop_list due to order', 0), 1395031298: (0.0, 'Should be the crop_list due to order', 0.0), 1395031296: (0.0, 'Should be the crop_list due to order', 0), 1395031293: (0.0, 'Should be the crop_list due to order', 0), 1395031288: (0.0, 'Should be the crop_list due to order', 0), 1395031286: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1395031888, 1395031878, 1395031873, 1395031867, 1395031832, 1395031829, 1395031823, 1395031817, 1395031477, 1395031448, 1395031408, 1395031385, 1395031381, 1395031379, 1395031329, 1395031321, 1395031319, 1395031316, 1395031314, 1395031311, 1395031301, 1395031298, 1395031296, 1395031293, 1395031288, 1395031286] Looping around the photos to save general results len do output : 26 /1395031888.Didn't retrieve data . /1395031878.Didn't retrieve data . /1395031873.Didn't retrieve data . /1395031867.Didn't retrieve data . /1395031832.Didn't retrieve data . /1395031829.Didn't retrieve data . /1395031823.Didn't retrieve data . /1395031817.Didn't retrieve data . /1395031477.Didn't retrieve data . /1395031448.Didn't retrieve data . /1395031408.Didn't retrieve data . /1395031385.Didn't retrieve data . /1395031381.Didn't retrieve data . /1395031379.Didn't retrieve data . /1395031329.Didn't retrieve data . /1395031321.Didn't retrieve data . /1395031319.Didn't retrieve data . /1395031316.Didn't retrieve data . /1395031314.Didn't retrieve data . /1395031311.Didn't retrieve data . /1395031301.Didn't retrieve data . /1395031298.Didn't retrieve data . /1395031296.Didn't retrieve data . /1395031293.Didn't retrieve data . /1395031288.Didn't retrieve data . /1395031286.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031888', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031878', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031873', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031867', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031832', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031829', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031823', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031817', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031477', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031448', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031408', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031385', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031381', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031379', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031329', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031321', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031319', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031316', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031314', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031311', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031301', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031298', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031296', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031293', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031288', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031286', None, None, None, None, None, '4066373') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 78 time used for this insertion : 0.01759791374206543 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.96958041191101 time spend to save output : 0.019208431243896484 total time spend for step 3 : 18.988788843154907 step4:ventilate_hashtags_in_portfolio Tue Nov 18 12:52:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28657587 get user id for portfolio 28657587 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28657587 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','pehd','background','metal','flou','autre','environnement','carton','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28657587 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','pehd','background','metal','flou','autre','environnement','carton','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28657587 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','pehd','background','metal','flou','autre','environnement','carton','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28657639,28657640,28657641,28657642,28657643,28657644,28657645,28657646,28657647,28657648,28657649?tags=pet_clair,papier,pehd,background,metal,flou,autre,environnement,carton,mal_croppe,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1395031888, 1395031878, 1395031873, 1395031867, 1395031832, 1395031829, 1395031823, 1395031817, 1395031477, 1395031448, 1395031408, 1395031385, 1395031381, 1395031379, 1395031329, 1395031321, 1395031319, 1395031316, 1395031314, 1395031311, 1395031301, 1395031298, 1395031296, 1395031293, 1395031288, 1395031286] Looping around the photos to save general results len do output : 1 /28657587. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031888', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031878', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031873', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031867', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031832', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031829', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031823', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031817', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031477', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031448', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031408', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031385', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031381', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031379', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031329', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031321', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031319', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031316', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031314', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031311', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031301', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031298', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031296', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031293', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031288', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031286', None, None, None, None, None, '4066373') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.019389629364013672 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6866707801818848 time spend to save output : 0.019760608673095703 total time spend for step 4 : 1.7064313888549805 step5:final Tue Nov 18 12:52:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1395031888: ('0.07675022628798672',), 1395031878: ('0.07675022628798672',), 1395031873: ('0.07675022628798672',), 1395031867: ('0.07675022628798672',), 1395031832: ('0.07675022628798672',), 1395031829: ('0.07675022628798672',), 1395031823: ('0.07675022628798672',), 1395031817: ('0.07675022628798672',), 1395031477: ('0.07675022628798672',), 1395031448: ('0.07675022628798672',), 1395031408: ('0.07675022628798672',), 1395031385: ('0.07675022628798672',), 1395031381: ('0.07675022628798672',), 1395031379: ('0.07675022628798672',), 1395031329: ('0.07675022628798672',), 1395031321: ('0.07675022628798672',), 1395031319: ('0.07675022628798672',), 1395031316: ('0.07675022628798672',), 1395031314: ('0.07675022628798672',), 1395031311: ('0.07675022628798672',), 1395031301: ('0.07675022628798672',), 1395031298: ('0.07675022628798672',), 1395031296: ('0.07675022628798672',), 1395031293: ('0.07675022628798672',), 1395031288: ('0.07675022628798672',), 1395031286: ('0.07675022628798672',)} new output for save of step final : {1395031888: ('0.07675022628798672',), 1395031878: ('0.07675022628798672',), 1395031873: ('0.07675022628798672',), 1395031867: ('0.07675022628798672',), 1395031832: ('0.07675022628798672',), 1395031829: ('0.07675022628798672',), 1395031823: ('0.07675022628798672',), 1395031817: ('0.07675022628798672',), 1395031477: ('0.07675022628798672',), 1395031448: ('0.07675022628798672',), 1395031408: ('0.07675022628798672',), 1395031385: ('0.07675022628798672',), 1395031381: ('0.07675022628798672',), 1395031379: ('0.07675022628798672',), 1395031329: ('0.07675022628798672',), 1395031321: ('0.07675022628798672',), 1395031319: ('0.07675022628798672',), 1395031316: ('0.07675022628798672',), 1395031314: ('0.07675022628798672',), 1395031311: ('0.07675022628798672',), 1395031301: ('0.07675022628798672',), 1395031298: ('0.07675022628798672',), 1395031296: ('0.07675022628798672',), 1395031293: ('0.07675022628798672',), 1395031288: ('0.07675022628798672',), 1395031286: ('0.07675022628798672',)} [1395031888, 1395031878, 1395031873, 1395031867, 1395031832, 1395031829, 1395031823, 1395031817, 1395031477, 1395031448, 1395031408, 1395031385, 1395031381, 1395031379, 1395031329, 1395031321, 1395031319, 1395031316, 1395031314, 1395031311, 1395031301, 1395031298, 1395031296, 1395031293, 1395031288, 1395031286] Looping around the photos to save general results len do output : 26 /1395031888.Didn't retrieve data . /1395031878.Didn't retrieve data . /1395031873.Didn't retrieve data . /1395031867.Didn't retrieve data . /1395031832.Didn't retrieve data . /1395031829.Didn't retrieve data . /1395031823.Didn't retrieve data . /1395031817.Didn't retrieve data . /1395031477.Didn't retrieve data . /1395031448.Didn't retrieve data . /1395031408.Didn't retrieve data . /1395031385.Didn't retrieve data . /1395031381.Didn't retrieve data . /1395031379.Didn't retrieve data . /1395031329.Didn't retrieve data . /1395031321.Didn't retrieve data . /1395031319.Didn't retrieve data . /1395031316.Didn't retrieve data . /1395031314.Didn't retrieve data . /1395031311.Didn't retrieve data . /1395031301.Didn't retrieve data . /1395031298.Didn't retrieve data . /1395031296.Didn't retrieve data . /1395031293.Didn't retrieve data . /1395031288.Didn't retrieve data . /1395031286.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031888', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031878', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031873', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031867', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031832', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031829', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031823', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031817', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031477', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031448', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031408', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031385', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031381', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031379', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031329', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031321', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031319', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031316', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031314', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031311', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031301', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031298', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031296', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031293', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031288', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031286', None, None, None, None, None, '4066373') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 78 time used for this insertion : 0.015301227569580078 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12317991256713867 time spend to save output : 0.016054153442382812 total time spend for step 5 : 0.13923406600952148 step6:blur_detection Tue Nov 18 12:52:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1763466627_3295735_1395031888_d94575672ffbe692481a14d090a07186.jpg resize: (1080, 1920) 1395031888 0.6868136348390049 treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618.jpg resize: (1080, 1920) 1395031878 1.0426961362930454 treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5.jpg resize: (1080, 1920) 1395031873 1.8075164146936853 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac.jpg resize: (1080, 1920) 1395031867 0.8090464753347383 treat image : temp/1763466627_3295735_1395031832_5112c25a9c67415c5a8d9f778633cb6d.jpg resize: (1080, 1920) 1395031832 0.15349786893631673 treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b.jpg resize: (1080, 1920) 1395031829 -2.894290295803036 treat image : temp/1763466627_3295735_1395031823_9019355e7ff84f9c699d6ca9d188ba04.jpg resize: (1080, 1920) 1395031823 0.3316730481022589 treat image : temp/1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa.jpg resize: (1080, 1920) 1395031817 0.3602256699768865 treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8.jpg resize: (1080, 1920) 1395031477 -3.259610818566924 treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a.jpg resize: (1080, 1920) 1395031448 0.49959901973525117 treat image : temp/1763466627_3295735_1395031408_cefde63c62eaa0156ac93e674fe23ab1.jpg resize: (1080, 1920) 1395031408 -2.8959387680939312 treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177.jpg resize: (1080, 1920) 1395031385 0.5263955509816355 treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d.jpg resize: (1080, 1920) 1395031381 1.0423266299314737 treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be.jpg resize: (1080, 1920) 1395031379 0.21339465468212082 treat image : temp/1763466627_3295735_1395031329_ac39dc66fc64680f50bf208f8443867d.jpg resize: (1080, 1920) 1395031329 0.8594864272903864 treat image : temp/1763466627_3295735_1395031321_4f37233700d76e0598612e5c410cc0f9.jpg resize: (1080, 1920) 1395031321 0.4039226911614365 treat image : temp/1763466627_3295735_1395031319_6de2ac0db2fa899f19e144f8b2b49186.jpg resize: (1080, 1920) 1395031319 1.8198846050315571 treat image : temp/1763466627_3295735_1395031316_4cc52d51b23b8e81f5f28b0ce21e0d31.jpg resize: (1080, 1920) 1395031316 0.818807514842155 treat image : temp/1763466627_3295735_1395031314_42e40edd33c43f3244e149bf991f53c7.jpg resize: (1080, 1920) 1395031314 0.9125240362374774 treat image : temp/1763466627_3295735_1395031311_c1316042d6653cf850d589775164e81d.jpg resize: (1080, 1920) 1395031311 0.4713114960682523 treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61.jpg resize: (1080, 1920) 1395031301 1.9129623707795655 treat image : temp/1763466627_3295735_1395031298_40ffedd3f255c9362d3bbf57a1374970.jpg resize: (1080, 1920) 1395031298 -0.07400217336658456 treat image : temp/1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0.jpg resize: (1080, 1920) 1395031296 0.13565496417396927 treat image : temp/1763466627_3295735_1395031293_7c85130eeb86aaba453b93d07c17a48a.jpg resize: (1080, 1920) 1395031293 1.3038858471930923 treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d.jpg resize: (1080, 1920) 1395031288 0.46258388092850183 treat image : temp/1763466627_3295735_1395031286_0b33223f8a7af9556397d23bd18e6a86.jpg resize: (1080, 1920) 1395031286 1.3807726033908079 treat image : temp/1763466627_3295735_1395031888_d94575672ffbe692481a14d090a07186_rle_crop_4037586102_0.png resize: (59, 86) 1395042470 -1.668350110156726 treat image : temp/1763466627_3295735_1395031888_d94575672ffbe692481a14d090a07186_rle_crop_4037586103_0.png resize: (137, 116) 1395042471 -2.3748810634643935 treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586104_0.png resize: (191, 234) 1395042472 -0.5518394358987012 treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586105_0.png resize: (173, 85) 1395042473 -0.15144079512017078 treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586106_0.png resize: (64, 68) 1395042474 0.43187220411800803 treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586107_0.png resize: (117, 99) 1395042475 1.232538731515853 treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586108_0.png resize: (137, 168) 1395042476 -1.0044483801488773 treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586109_0.png resize: (88, 51) 1395042477 3.3543564440224296 treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586110_0.png resize: (95, 123) 1395042478 -0.8379953456625091 treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586111_0.png resize: (61, 132) 1395042479 -1.1133663677820433 treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586112_0.png resize: (124, 87) 1395042480 -0.07804060055936896 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586113_0.png resize: (97, 123) 1395042481 -0.7898020099366397 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586114_0.png resize: (101, 115) 1395042482 -1.3247089917941786 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586118_0.png resize: (92, 98) 1395042483 -0.24831910194103413 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586119_0.png resize: (114, 99) 1395042484 -1.021655556815078 treat image : temp/1763466627_3295735_1395031832_5112c25a9c67415c5a8d9f778633cb6d_rle_crop_4037586121_0.png resize: (86, 149) 1395042485 -1.1032913763859629 treat image : temp/1763466627_3295735_1395031832_5112c25a9c67415c5a8d9f778633cb6d_rle_crop_4037586122_0.png resize: (116, 102) 1395042486 -1.2155663672598174 treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586124_0.png resize: (87, 190) 1395042487 -3.0492255948738585 treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586125_0.png resize: (88, 67) 1395042488 0.1276462408147524 treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586127_0.png resize: (109, 128) 1395042489 -2.412504174552918 treat image : temp/1763466627_3295735_1395031823_9019355e7ff84f9c699d6ca9d188ba04_rle_crop_4037586128_0.png resize: (81, 123) 1395042490 -0.26825182902477107 treat image : temp/1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586130_0.png resize: (124, 134) 1395042491 -0.00034576874510099787 treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586133_0.png resize: (129, 175) 1395042492 -0.18777903140676086 treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586136_0.png resize: (122, 130) 1395042493 -4.925940312613922 treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586138_0.png resize: (128, 76) 1395042494 0.6173590810726197 treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586141_0.png resize: (106, 60) 1395042495 6.984946811424815 treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586142_0.png resize: (97, 135) 1395042496 -0.8740885085434672 treat image : temp/1763466627_3295735_1395031408_cefde63c62eaa0156ac93e674fe23ab1_rle_crop_4037586143_0.png resize: (82, 71) 1395042497 -1.8542072738005035 treat image : temp/1763466627_3295735_1395031408_cefde63c62eaa0156ac93e674fe23ab1_rle_crop_4037586144_0.png resize: (44, 111) 1395042498 -1.4857523597474636 treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586151_0.png resize: (53, 69) 1395042499 1.9508319458160732 treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586154_0.png resize: (106, 81) 1395042500 -1.33485767657571 treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586155_0.png resize: (90, 104) 1395042501 -0.6777041429518034 treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586156_0.png resize: (76, 59) 1395042502 -0.7543880013988761 treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586157_0.png resize: (125, 148) 1395042503 -0.13253858474645425 treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586158_0.png resize: (128, 70) 1395042504 0.9161591704005352 treat image : temp/1763466627_3295735_1395031329_ac39dc66fc64680f50bf208f8443867d_rle_crop_4037586159_0.png resize: (82, 179) 1395042505 1.2301366247327725 treat image : temp/1763466627_3295735_1395031316_4cc52d51b23b8e81f5f28b0ce21e0d31_rle_crop_4037586163_0.png resize: (125, 150) 1395042506 -0.6492851588816031 treat image : temp/1763466627_3295735_1395031316_4cc52d51b23b8e81f5f28b0ce21e0d31_rle_crop_4037586164_0.png resize: (80, 86) 1395042507 0.16620275025820722 treat image : temp/1763466627_3295735_1395031314_42e40edd33c43f3244e149bf991f53c7_rle_crop_4037586165_0.png resize: (119, 69) 1395042508 -2.2172229117659943 treat image : temp/1763466627_3295735_1395031311_c1316042d6653cf850d589775164e81d_rle_crop_4037586167_0.png resize: (152, 119) 1395042509 -1.40211957374483 treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586169_0.png resize: (134, 148) 1395042510 -0.9402314645165284 treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586171_0.png resize: (181, 252) 1395042511 -0.4498587647126031 treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586172_0.png resize: (83, 139) 1395042512 0.01567353315085874 treat image : temp/1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586173_0.png resize: (158, 67) 1395042513 -1.7322392619525504 treat image : temp/1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586174_0.png resize: (92, 86) 1395042514 -1.211281231740577 treat image : temp/1763466627_3295735_1395031293_7c85130eeb86aaba453b93d07c17a48a_rle_crop_4037586176_0.png resize: (141, 99) 1395042515 -1.8256641695252842 treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586178_0.png resize: (126, 76) 1395042516 -1.3562874066789266 treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586180_0.png resize: (82, 52) 1395042517 0.18147112015324302 treat image : temp/1763466627_3295735_1395031286_0b33223f8a7af9556397d23bd18e6a86_rle_crop_4037586181_0.png resize: (87, 73) 1395042518 -0.6960270915828113 treat image : temp/1763466627_3295735_1395031286_0b33223f8a7af9556397d23bd18e6a86_rle_crop_4037586182_0.png resize: (328, 140) 1395042519 -1.469564532870846 treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586147_0.png resize: (530, 354) 1395042522 -0.37565358464791443 treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586126_0.png resize: (32, 86) 1395042524 1.2587307194216986 treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586134_0.png resize: (62, 141) 1395042525 -0.05420379384295704 treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586152_0.png resize: (87, 99) 1395042526 0.06912497802951525 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586115_0.png resize: (204, 169) 1395042539 -0.5817489380928295 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586116_0.png resize: (173, 113) 1395042540 -1.3120626608765453 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586117_0.png resize: (189, 220) 1395042541 -2.6342036201665096 treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586120_0.png resize: (150, 133) 1395042542 -1.3834287159017224 treat image : temp/1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586129_0.png resize: (516, 341) 1395042543 0.1480436085728874 treat image : temp/1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586131_0.png resize: (136, 85) 1395042544 0.015279704155478167 treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586135_0.png resize: (111, 230) 1395042545 -3.5756440452974254 treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586137_0.png resize: (67, 127) 1395042546 -1.2227291441766732 treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586139_0.png resize: (226, 156) 1395042547 -1.6013561230633648 treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586140_0.png resize: (92, 141) 1395042548 -0.0724537951068942 treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586145_0.png resize: (171, 115) 1395042549 -1.725006830107173 treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586148_0.png resize: (144, 91) 1395042550 -1.8223471854183997 treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586149_0.png resize: (312, 480) 1395042551 -1.2426697142342558 treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586150_0.png resize: (152, 128) 1395042553 -2.3601209203032867 treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586153_0.png resize: (1017, 1636) 1395042554 -0.4587201319955432 treat image : temp/1763466627_3295735_1395031321_4f37233700d76e0598612e5c410cc0f9_rle_crop_4037586160_0.png resize: (86, 131) 1395042555 -0.05185286471196324 treat image : temp/1763466627_3295735_1395031321_4f37233700d76e0598612e5c410cc0f9_rle_crop_4037586161_0.png resize: (95, 191) 1395042556 -1.5876934524007849 treat image : temp/1763466627_3295735_1395031319_6de2ac0db2fa899f19e144f8b2b49186_rle_crop_4037586162_0.png resize: (151, 90) 1395042557 -0.6059904749179357 treat image : temp/1763466627_3295735_1395031314_42e40edd33c43f3244e149bf991f53c7_rle_crop_4037586166_0.png resize: (177, 136) 1395042558 -0.7471827909706722 treat image : temp/1763466627_3295735_1395031311_c1316042d6653cf850d589775164e81d_rle_crop_4037586168_0.png resize: (996, 1135) 1395042559 0.3788662973176619 treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586170_0.png resize: (83, 98) 1395042560 -1.8137943452182517 treat image : temp/1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586175_0.png resize: (1022, 957) 1395042561 -0.4022091006977251 treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586177_0.png resize: (167, 230) 1395042562 -0.866470994022985 treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586179_0.png resize: (321, 162) 1395042563 -1.1671254536065014 treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586123_0.png resize: (175, 93) 1395042564 0.01204388560764389 treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586132_0.png resize: (127, 114) 1395042565 1.543074539245138 treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586146_0.png resize: (64, 125) 1395042566 -1.112057723213182 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 107 time used for this insertion : 0.01898813247680664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 107 time used for this insertion : 0.03512310981750488 save missing photos in datou_result : time spend for datou_step_exec : 23.35361647605896 time spend to save output : 0.0595555305480957 total time spend for step 6 : 23.413172006607056 step7:brightness Tue Nov 18 12:52:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1763466627_3295735_1395031888_d94575672ffbe692481a14d090a07186.jpg treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618.jpg treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5.jpg treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac.jpg treat image : temp/1763466627_3295735_1395031832_5112c25a9c67415c5a8d9f778633cb6d.jpg treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b.jpg treat image : temp/1763466627_3295735_1395031823_9019355e7ff84f9c699d6ca9d188ba04.jpg treat image : temp/1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa.jpg treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8.jpg treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a.jpg treat image : temp/1763466627_3295735_1395031408_cefde63c62eaa0156ac93e674fe23ab1.jpg treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177.jpg treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d.jpg treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be.jpg treat image : temp/1763466627_3295735_1395031329_ac39dc66fc64680f50bf208f8443867d.jpg treat image : temp/1763466627_3295735_1395031321_4f37233700d76e0598612e5c410cc0f9.jpg treat image : temp/1763466627_3295735_1395031319_6de2ac0db2fa899f19e144f8b2b49186.jpg treat image : temp/1763466627_3295735_1395031316_4cc52d51b23b8e81f5f28b0ce21e0d31.jpg treat image : temp/1763466627_3295735_1395031314_42e40edd33c43f3244e149bf991f53c7.jpg treat image : temp/1763466627_3295735_1395031311_c1316042d6653cf850d589775164e81d.jpg treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61.jpg treat image : temp/1763466627_3295735_1395031298_40ffedd3f255c9362d3bbf57a1374970.jpg treat image : temp/1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0.jpg treat image : temp/1763466627_3295735_1395031293_7c85130eeb86aaba453b93d07c17a48a.jpg treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d.jpg treat image : temp/1763466627_3295735_1395031286_0b33223f8a7af9556397d23bd18e6a86.jpg treat image : temp/1763466627_3295735_1395031888_d94575672ffbe692481a14d090a07186_rle_crop_4037586102_0.png treat image : temp/1763466627_3295735_1395031888_d94575672ffbe692481a14d090a07186_rle_crop_4037586103_0.png treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586104_0.png treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586105_0.png treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586106_0.png treat image : temp/1763466627_3295735_1395031878_0c1182f3907cfa4d21df1ae048fb4618_rle_crop_4037586107_0.png treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586108_0.png treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586109_0.png treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586110_0.png treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586111_0.png treat image : temp/1763466627_3295735_1395031873_e06b20a8e76a79f09b25e20b41fc64d5_rle_crop_4037586112_0.png treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586113_0.png treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586114_0.png treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586118_0.png treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586119_0.png treat image : temp/1763466627_3295735_1395031832_5112c25a9c67415c5a8d9f778633cb6d_rle_crop_4037586121_0.png treat image : temp/1763466627_3295735_1395031832_5112c25a9c67415c5a8d9f778633cb6d_rle_crop_4037586122_0.png treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586124_0.png treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586125_0.png treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586127_0.png treat image : temp/1763466627_3295735_1395031823_9019355e7ff84f9c699d6ca9d188ba04_rle_crop_4037586128_0.png treat image : temp/1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586130_0.png treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586133_0.png treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586136_0.png treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586138_0.png treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586141_0.png treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586142_0.png treat image : temp/1763466627_3295735_1395031408_cefde63c62eaa0156ac93e674fe23ab1_rle_crop_4037586143_0.png treat image : temp/1763466627_3295735_1395031408_cefde63c62eaa0156ac93e674fe23ab1_rle_crop_4037586144_0.png treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586151_0.png treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586154_0.png treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586155_0.png treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586156_0.png treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586157_0.png treat image : temp/1763466627_3295735_1395031379_b1b624e6e3854fe863306e50f63a34be_rle_crop_4037586158_0.png treat image : temp/1763466627_3295735_1395031329_ac39dc66fc64680f50bf208f8443867d_rle_crop_4037586159_0.png treat image : temp/1763466627_3295735_1395031316_4cc52d51b23b8e81f5f28b0ce21e0d31_rle_crop_4037586163_0.png treat image : temp/1763466627_3295735_1395031316_4cc52d51b23b8e81f5f28b0ce21e0d31_rle_crop_4037586164_0.png treat image : temp/1763466627_3295735_1395031314_42e40edd33c43f3244e149bf991f53c7_rle_crop_4037586165_0.png treat image : temp/1763466627_3295735_1395031311_c1316042d6653cf850d589775164e81d_rle_crop_4037586167_0.png treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586169_0.png treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586171_0.png treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586172_0.png treat image : temp/1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586173_0.png treat image : temp/1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586174_0.png treat image : temp/1763466627_3295735_1395031293_7c85130eeb86aaba453b93d07c17a48a_rle_crop_4037586176_0.png treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586178_0.png treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586180_0.png treat image : temp/1763466627_3295735_1395031286_0b33223f8a7af9556397d23bd18e6a86_rle_crop_4037586181_0.png treat image : temp/1763466627_3295735_1395031286_0b33223f8a7af9556397d23bd18e6a86_rle_crop_4037586182_0.png treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586147_0.png treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586126_0.png treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586134_0.png treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586152_0.png treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586115_0.png treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586116_0.png treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586117_0.png treat image : temp/1763466627_3295735_1395031867_adf3c70b9381c878d0685d3c51528fac_rle_crop_4037586120_0.png treat image : temp/1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586129_0.png treat image : temp/1763466627_3295735_1395031817_7afbeff8c50da2e5ce89ff72bba1afaa_rle_crop_4037586131_0.png treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586135_0.png treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586137_0.png treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586139_0.png treat image : temp/1763466627_3295735_1395031448_a716c17987b4aa424437be510123e53a_rle_crop_4037586140_0.png treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586145_0.png treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586148_0.png treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586149_0.png treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586150_0.png treat image : temp/1763466627_3295735_1395031381_d57bcdd6e77eb2533e466bd034113f9d_rle_crop_4037586153_0.png treat image : temp/1763466627_3295735_1395031321_4f37233700d76e0598612e5c410cc0f9_rle_crop_4037586160_0.png treat image : temp/1763466627_3295735_1395031321_4f37233700d76e0598612e5c410cc0f9_rle_crop_4037586161_0.png treat image : temp/1763466627_3295735_1395031319_6de2ac0db2fa899f19e144f8b2b49186_rle_crop_4037586162_0.png treat image : temp/1763466627_3295735_1395031314_42e40edd33c43f3244e149bf991f53c7_rle_crop_4037586166_0.png treat image : temp/1763466627_3295735_1395031311_c1316042d6653cf850d589775164e81d_rle_crop_4037586168_0.png treat image : temp/1763466627_3295735_1395031301_c9e19b7bfd36f7202d722304f96a4f61_rle_crop_4037586170_0.png treat image : temp/1763466627_3295735_1395031296_3be56033b671c9eab65b1b1678584eb0_rle_crop_4037586175_0.png treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586177_0.png treat image : temp/1763466627_3295735_1395031288_b079846e4be5745cfa60b9d0f7d65d3d_rle_crop_4037586179_0.png treat image : temp/1763466627_3295735_1395031829_e5a33d6dde3e25e36324cf62947bc26b_rle_crop_4037586123_0.png treat image : temp/1763466627_3295735_1395031477_c96b784e72c1ebc6f59ea5189f9a67a8_rle_crop_4037586132_0.png treat image : temp/1763466627_3295735_1395031385_40932abad33059f57013d99a9fc58177_rle_crop_4037586146_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 107 time used for this insertion : 0.017972946166992188 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 107 time used for this insertion : 0.0347442626953125 save missing photos in datou_result : time spend for datou_step_exec : 6.52813196182251 time spend to save output : 0.05756354331970215 total time spend for step 7 : 6.585695505142212 step8:velours_tree Tue Nov 18 12:52:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1428830623626709 time spend to save output : 5.412101745605469e-05 total time spend for step 8 : 0.14293718338012695 step9:send_mail_cod Tue Nov 18 12:52:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28657587_18-11-2025_12_52_43.pdf 28657639 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286576391763466763 28657640 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286576401763466765 28657641 imagette286576411763466766 28657642 imagette286576421763466766 28657643 change filename to text .change filename to text .change filename to text .imagette286576431763466766 28657644 imagette286576441763466766 28657645 change filename to text .change filename to text .change filename to text .imagette286576451763466766 28657647 change filename to text .imagette286576471763466767 28657648 imagette286576481763466767 28657649 imagette286576491763466767 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28657587 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28657639,28657640,28657641,28657642,28657643,28657644,28657645,28657646,28657647,28657648,28657649?tags=pet_clair,papier,pehd,background,metal,flou,autre,environnement,carton,mal_croppe,pet_fonce args[1395031888] : ((1395031888, 0.6868136348390049, 492688767), (1395031888, 0.41622533217100527, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031878] : ((1395031878, 1.0426961362930454, 492688767), (1395031878, 0.5584047224450388, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031873] : ((1395031873, 1.8075164146936853, 492688767), (1395031873, 0.509105601271932, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031867] : ((1395031867, 0.8090464753347383, 492688767), (1395031867, 0.5739773184977076, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031832] : ((1395031832, 0.15349786893631673, 492688767), (1395031832, 1.1155402053756422, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031829] : ((1395031829, -2.894290295803036, 492609224), (1395031829, 0.37573217325507424, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031823] : ((1395031823, 0.3316730481022589, 492688767), (1395031823, 0.42829762781848857, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031817] : ((1395031817, 0.3602256699768865, 492688767), (1395031817, 0.3770818611056358, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031477] : ((1395031477, -3.259610818566924, 492609224), (1395031477, 0.22026349581272225, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031448] : ((1395031448, 0.49959901973525117, 492688767), (1395031448, 0.6369222197512097, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031408] : ((1395031408, -2.8959387680939312, 492609224), (1395031408, 0.4607671427270841, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031385] : ((1395031385, 0.5263955509816355, 492688767), (1395031385, 0.44055533514384193, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031381] : ((1395031381, 1.0423266299314737, 492688767), (1395031381, 0.25946822136770403, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031379] : ((1395031379, 0.21339465468212082, 492688767), (1395031379, 0.5973202176730508, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031329] : ((1395031329, 0.8594864272903864, 492688767), (1395031329, 0.6978334230569866, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031321] : ((1395031321, 0.4039226911614365, 492688767), (1395031321, 0.5400200604392591, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031319] : ((1395031319, 1.8198846050315571, 492688767), (1395031319, 0.81948506201082, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031316] : ((1395031316, 0.818807514842155, 492688767), (1395031316, 0.8198543067628756, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031314] : ((1395031314, 0.9125240362374774, 492688767), (1395031314, 0.4976266290265766, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031311] : ((1395031311, 0.4713114960682523, 492688767), (1395031311, 0.6364870632348009, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031301] : ((1395031301, 1.9129623707795655, 492688767), (1395031301, 0.8748891069068475, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031298] : ((1395031298, -0.07400217336658456, 492688767), (1395031298, 0.7641467710270528, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031296] : ((1395031296, 0.13565496417396927, 492688767), (1395031296, 0.7868826204726477, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031293] : ((1395031293, 1.3038858471930923, 492688767), (1395031293, 0.623344992667151, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031288] : ((1395031288, 0.46258388092850183, 492688767), (1395031288, 0.608982570312459, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com args[1395031286] : ((1395031286, 1.3807726033908079, 492688767), (1395031286, 0.8392668791915384, 2107752395), '0.07675022628798672') We are sending mail with results at report@fotonower.com refus_total : 0.07675022628798672 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28657587 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657587_18-11-2025_12_52_43.pdf results_Auto_P28657587_18-11-2025_12_52_43.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657587_18-11-2025_12_52_43.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28657587','results_Auto_P28657587_18-11-2025_12_52_43.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657587_18-11-2025_12_52_43.pdf','pdf','','0.59','0.07675022628798672') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28657587

https://www.fotonower.com/image?json=false&list_photos_id=1395031888
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031878
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0426961362930454)
https://www.fotonower.com/image?json=false&list_photos_id=1395031873
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.8075164146936853)
https://www.fotonower.com/image?json=false&list_photos_id=1395031867
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031832
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031829
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031823
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031817
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031477
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031448
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031408
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031385
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031381
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0423266299314737)
https://www.fotonower.com/image?json=false&list_photos_id=1395031379
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031329
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031321
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031319
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.8198846050315571)
https://www.fotonower.com/image?json=false&list_photos_id=1395031316
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031314
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031311
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031301
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.9129623707795655)
https://www.fotonower.com/image?json=false&list_photos_id=1395031298
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031296
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031293
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3038858471930923)
https://www.fotonower.com/image?json=false&list_photos_id=1395031288
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395031286
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3807726033908079)

Dans ces conditions,le taux de refus est: 7.68%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/28657639?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28657640?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28657643?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28657645?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28657647?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657587_18-11-2025_12_52_43.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28657639,28657640,28657641,28657642,28657643,28657644,28657645,28657646,28657647,28657648,28657649?tags=pet_clair,papier,pehd,background,metal,flou,autre,environnement,carton,mal_croppe,pet_fonce.


L'équipe Fotonower 202 b'' Date: Tue, 18 Nov 2025 11:52:49 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: WCDCbJYvQbWVi-Yat9RZGQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1395031888, 1395031878, 1395031873, 1395031867, 1395031832, 1395031829, 1395031823, 1395031817, 1395031477, 1395031448, 1395031408, 1395031385, 1395031381, 1395031379, 1395031329, 1395031321, 1395031319, 1395031316, 1395031314, 1395031311, 1395031301, 1395031298, 1395031296, 1395031293, 1395031288, 1395031286] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031888', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031878', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031873', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031867', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031832', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031829', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031823', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031817', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031477', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031448', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031408', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031385', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031381', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031379', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031329', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031321', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031319', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031316', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031314', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031311', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031301', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031298', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031296', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031293', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031288', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031286', None, None, None, None, None, '4066373') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.020148277282714844 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.995804786682129 time spend to save output : 0.02054572105407715 total time spend for step 9 : 6.016350507736206 step10:split_time_score Tue Nov 18 12:52:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 26),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 18112025 28657587 Nombre de photos uploadées : 26 / 23040 (0%) 18112025 28657587 Nombre de photos taguées (types de déchets): 0 / 26 (0%) 18112025 28657587 Nombre de photos taguées (volume) : 0 / 26 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0013155937194824219 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20982670783996582 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.10302089006899057 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28650767_18-11-2025_09_31_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28650767 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28650767 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28657578 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28657580 order by id desc limit 1 Qualite : 0.07675022628798672 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657587_18-11-2025_12_52_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28657587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28657587 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'18112025': {'nb_upload': 26, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1395031888, 1395031878, 1395031873, 1395031867, 1395031832, 1395031829, 1395031823, 1395031817, 1395031477, 1395031448, 1395031408, 1395031385, 1395031381, 1395031379, 1395031329, 1395031321, 1395031319, 1395031316, 1395031314, 1395031311, 1395031301, 1395031298, 1395031296, 1395031293, 1395031288, 1395031286] Looping around the photos to save general results len do output : 1 /28657587Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031888', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031878', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031873', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031867', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031832', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031829', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031823', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031817', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031477', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031448', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031408', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031385', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031381', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031379', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031329', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031321', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031319', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031316', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031314', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031311', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031301', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031298', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031296', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031293', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031288', None, None, None, None, None, '4066373') ('3318', None, None, None, None, None, None, None, '4066373') ('3318', '28657587', '1395031286', None, None, None, None, None, '4066373') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.01667189598083496 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.955660343170166 time spend to save output : 0.0169980525970459 total time spend for step 10 : 2.972658395767212 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 26 set_done_treatment 79.38user 38.62system 2:28.46elapsed 79%CPU (0avgtext+0avgdata 3175480maxresident)k 614088inputs+43568outputs (2010major+2580725minor)pagefaults 0swaps