python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2463151 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3929010'] with mtr_portfolio_ids : ['27729545'] and first list_photo_ids : [] new path : /proc/2463151/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 23 ; length of list_pids : 23 ; length of list_args : 23 time to download the photos : 3.5433857440948486 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Oct 11 12:30:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3027 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-11 12:30:38.047351: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-11 12:30:38.074434: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-11 12:30:38.075914: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fed70000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-11 12:30:38.075965: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-11 12:30:38.078530: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-11 12:30:38.329102: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x11122090 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-11 12:30:38.329152: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-11 12:30:38.330217: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-11 12:30:38.330694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-11 12:30:38.334475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-11 12:30:38.339815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-11 12:30:38.340256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-11 12:30:38.349876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-11 12:30:38.352345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-11 12:30:38.370335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-11 12:30:38.371594: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-11 12:30:38.371688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-11 12:30:38.372382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-11 12:30:38.372402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-11 12:30:38.372414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-11 12:30:38.373772: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2575 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-11 12:30:38.817496: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-11 12:30:38.817624: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-11 12:30:38.817653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-11 12:30:38.817680: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-11 12:30:38.817706: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-11 12:30:38.817731: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-11 12:30:38.817756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-11 12:30:38.817781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-11 12:30:38.819641: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-11 12:30:38.820708: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-11 12:30:38.820743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-11 12:30:38.820759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-11 12:30:38.820774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-11 12:30:38.820789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-11 12:30:38.820803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-11 12:30:38.820817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-11 12:30:38.820831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-11 12:30:38.821558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-11 12:30:38.821593: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-11 12:30:38.821602: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-11 12:30:38.821609: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-11 12:30:38.822430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2575 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-11 12:30:46.233823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-11 12:30:46.419348: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-11 12:30:47.916080: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:47.916148: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:47.922575: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:47.922597: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:47.972517: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:47.972585: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:48.014223: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:48.014251: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:48.063085: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:48.063115: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:30:48.065154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.52G (1628307456 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.065664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.36G (1465476608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.375175: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-10-11 12:30:48.424849: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.425915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.427264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.428285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.438453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.439003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.439564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.440108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.440651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.441194: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.455392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.455954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.504039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.504627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.512393: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.513002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.528886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.529762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.530616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.531456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.535656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.536211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.536762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.537313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.538246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.538261: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-11 12:30:48.548383: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.548934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.557768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.558332: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.558941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.559543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.560101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:30:48.560651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 23 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 67.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 51.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 0 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 2463835 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1834 tf kernel not reseted sub process len(results) : 23 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 23 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3027 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0001633167266845703 nb_pixel_total : 4996 time to create 1 rle with old method : 0.00628662109375 length of segment : 62 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 5024 time to create 1 rle with old method : 0.006106376647949219 length of segment : 65 time for calcul the mask position with numpy : 0.0018494129180908203 nb_pixel_total : 110631 time to create 1 rle with old method : 0.12501263618469238 length of segment : 607 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 4428 time to create 1 rle with old method : 0.0052700042724609375 length of segment : 75 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 4286 time to create 1 rle with old method : 0.005072832107543945 length of segment : 83 time for calcul the mask position with numpy : 0.0003151893615722656 nb_pixel_total : 27853 time to create 1 rle with old method : 0.03210949897766113 length of segment : 203 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 5368 time to create 1 rle with old method : 0.006127119064331055 length of segment : 69 time for calcul the mask position with numpy : 0.0001385211944580078 nb_pixel_total : 7193 time to create 1 rle with old method : 0.00864553451538086 length of segment : 123 time for calcul the mask position with numpy : 0.000164031982421875 nb_pixel_total : 8478 time to create 1 rle with old method : 0.010266304016113281 length of segment : 147 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 2716 time to create 1 rle with old method : 0.0032682418823242188 length of segment : 44 time for calcul the mask position with numpy : 0.0002715587615966797 nb_pixel_total : 18804 time to create 1 rle with old method : 0.021602153778076172 length of segment : 121 time for calcul the mask position with numpy : 0.0017757415771484375 nb_pixel_total : 112833 time to create 1 rle with old method : 0.12829995155334473 length of segment : 541 time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 6257 time to create 1 rle with old method : 0.007216691970825195 length of segment : 146 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 4404 time to create 1 rle with old method : 0.005225658416748047 length of segment : 59 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 4724 time to create 1 rle with old method : 0.0054738521575927734 length of segment : 107 time for calcul the mask position with numpy : 0.0002944469451904297 nb_pixel_total : 23169 time to create 1 rle with old method : 0.027100086212158203 length of segment : 117 time for calcul the mask position with numpy : 0.00830388069152832 nb_pixel_total : 533346 time to create 1 rle with new method : 0.021569490432739258 length of segment : 1006 time for calcul the mask position with numpy : 0.00016260147094726562 nb_pixel_total : 6819 time to create 1 rle with old method : 0.008234977722167969 length of segment : 82 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2571 time to create 1 rle with old method : 0.0032536983489990234 length of segment : 35 time for calcul the mask position with numpy : 0.0010886192321777344 nb_pixel_total : 85878 time to create 1 rle with old method : 0.10091781616210938 length of segment : 244 time for calcul the mask position with numpy : 0.007705211639404297 nb_pixel_total : 436863 time to create 1 rle with new method : 0.015359640121459961 length of segment : 1425 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 2464 time to create 1 rle with old method : 0.0031223297119140625 length of segment : 58 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 3552 time to create 1 rle with old method : 0.004247188568115234 length of segment : 40 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2370 time to create 1 rle with old method : 0.002838611602783203 length of segment : 58 time for calcul the mask position with numpy : 0.00039458274841308594 nb_pixel_total : 9529 time to create 1 rle with old method : 0.010709047317504883 length of segment : 179 time for calcul the mask position with numpy : 0.0004978179931640625 nb_pixel_total : 18820 time to create 1 rle with old method : 0.021646738052368164 length of segment : 148 time for calcul the mask position with numpy : 0.0021474361419677734 nb_pixel_total : 92833 time to create 1 rle with old method : 0.10666251182556152 length of segment : 517 time for calcul the mask position with numpy : 0.0004124641418457031 nb_pixel_total : 11728 time to create 1 rle with old method : 0.013788461685180664 length of segment : 144 time for calcul the mask position with numpy : 0.0002796649932861328 nb_pixel_total : 6187 time to create 1 rle with old method : 0.007608175277709961 length of segment : 129 time for calcul the mask position with numpy : 0.0002751350402832031 nb_pixel_total : 9207 time to create 1 rle with old method : 0.011051416397094727 length of segment : 152 time for calcul the mask position with numpy : 0.000270843505859375 nb_pixel_total : 6020 time to create 1 rle with old method : 0.007580757141113281 length of segment : 97 time for calcul the mask position with numpy : 0.00011920928955078125 nb_pixel_total : 6135 time to create 1 rle with old method : 0.007570743560791016 length of segment : 68 time for calcul the mask position with numpy : 0.00021529197692871094 nb_pixel_total : 5814 time to create 1 rle with old method : 0.006758213043212891 length of segment : 77 time for calcul the mask position with numpy : 0.00012445449829101562 nb_pixel_total : 2478 time to create 1 rle with old method : 0.0030379295349121094 length of segment : 56 time for calcul the mask position with numpy : 0.002371072769165039 nb_pixel_total : 112450 time to create 1 rle with old method : 0.12539076805114746 length of segment : 570 time for calcul the mask position with numpy : 0.014861345291137695 nb_pixel_total : 1054105 time to create 1 rle with new method : 0.02945995330810547 length of segment : 1531 time for calcul the mask position with numpy : 0.0013837814331054688 nb_pixel_total : 96012 time to create 1 rle with old method : 0.10830163955688477 length of segment : 510 time for calcul the mask position with numpy : 0.0018310546875 nb_pixel_total : 96717 time to create 1 rle with old method : 0.10876703262329102 length of segment : 534 time for calcul the mask position with numpy : 0.0019161701202392578 nb_pixel_total : 98872 time to create 1 rle with old method : 0.12305736541748047 length of segment : 566 time for calcul the mask position with numpy : 0.00013017654418945312 nb_pixel_total : 1601 time to create 1 rle with old method : 0.0020227432250976562 length of segment : 58 time for calcul the mask position with numpy : 0.001932382583618164 nb_pixel_total : 99709 time to create 1 rle with old method : 0.11493372917175293 length of segment : 533 time for calcul the mask position with numpy : 0.00025343894958496094 nb_pixel_total : 5079 time to create 1 rle with old method : 0.006052732467651367 length of segment : 130 time for calcul the mask position with numpy : 0.0018279552459716797 nb_pixel_total : 93705 time to create 1 rle with old method : 0.1064155101776123 length of segment : 545 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 2171 time to create 1 rle with old method : 0.0025620460510253906 length of segment : 59 time for calcul the mask position with numpy : 0.0001437664031982422 nb_pixel_total : 2951 time to create 1 rle with old method : 0.0037627220153808594 length of segment : 66 time for calcul the mask position with numpy : 0.0005242824554443359 nb_pixel_total : 18981 time to create 1 rle with old method : 0.022089481353759766 length of segment : 227 time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 12890 time to create 1 rle with old method : 0.01475381851196289 length of segment : 157 time for calcul the mask position with numpy : 0.00020599365234375 nb_pixel_total : 7809 time to create 1 rle with old method : 0.009032011032104492 length of segment : 76 time for calcul the mask position with numpy : 0.009375572204589844 nb_pixel_total : 496026 time to create 1 rle with new method : 0.018957138061523438 length of segment : 788 time for calcul the mask position with numpy : 0.0002090930938720703 nb_pixel_total : 7793 time to create 1 rle with old method : 0.009188413619995117 length of segment : 228 time for calcul the mask position with numpy : 0.0002117156982421875 nb_pixel_total : 5523 time to create 1 rle with old method : 0.0067636966705322266 length of segment : 76 time for calcul the mask position with numpy : 0.0023245811462402344 nb_pixel_total : 107169 time to create 1 rle with old method : 0.12196683883666992 length of segment : 522 time for calcul the mask position with numpy : 0.00016450881958007812 nb_pixel_total : 3094 time to create 1 rle with old method : 0.0037806034088134766 length of segment : 72 time for calcul the mask position with numpy : 0.0002624988555908203 nb_pixel_total : 7923 time to create 1 rle with old method : 0.010827302932739258 length of segment : 115 time for calcul the mask position with numpy : 0.0003581047058105469 nb_pixel_total : 5373 time to create 1 rle with old method : 0.006613492965698242 length of segment : 161 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 5126 time to create 1 rle with old method : 0.00608062744140625 length of segment : 116 time for calcul the mask position with numpy : 0.0002009868621826172 nb_pixel_total : 5843 time to create 1 rle with old method : 0.007115840911865234 length of segment : 90 time for calcul the mask position with numpy : 0.0003273487091064453 nb_pixel_total : 10673 time to create 1 rle with old method : 0.012427091598510742 length of segment : 179 time for calcul the mask position with numpy : 0.008689403533935547 nb_pixel_total : 601760 time to create 1 rle with new method : 0.015398025512695312 length of segment : 988 time for calcul the mask position with numpy : 0.00013685226440429688 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0014367103576660156 length of segment : 53 time for calcul the mask position with numpy : 0.00028014183044433594 nb_pixel_total : 6689 time to create 1 rle with old method : 0.008208751678466797 length of segment : 92 time for calcul the mask position with numpy : 0.0006122589111328125 nb_pixel_total : 28264 time to create 1 rle with old method : 0.033882856369018555 length of segment : 112 time for calcul the mask position with numpy : 0.00030112266540527344 nb_pixel_total : 6333 time to create 1 rle with old method : 0.010892629623413086 length of segment : 99 time for calcul the mask position with numpy : 0.0002338886260986328 nb_pixel_total : 5036 time to create 1 rle with old method : 0.021930694580078125 length of segment : 133 time for calcul the mask position with numpy : 0.001691579818725586 nb_pixel_total : 70549 time to create 1 rle with old method : 0.0821695327758789 length of segment : 259 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 6528 time to create 1 rle with old method : 0.007979869842529297 length of segment : 115 time for calcul the mask position with numpy : 0.00017595291137695312 nb_pixel_total : 4095 time to create 1 rle with old method : 0.005242109298706055 length of segment : 67 time spent for convertir_results : 4.744866132736206 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 67 chid ids of type : 3594 Number RLEs to save : 16911 save missing photos in datou_result : time spend for datou_step_exec : 29.697580337524414 time spend to save output : 1.937476396560669 total time spend for step 1 : 31.635056734085083 step2:crop_condition Sat Oct 11 12:31:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 23 ! batch 1 Loaded 67 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760178669_2463151 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414714_0.png', 0, 73, 78, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414713_0.png', 0, 90, 75, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414710_0.png', 0, 117, 60, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414711_0.png', 0, 131, 59, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414719_0.png', 0, 74, 44, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414717_0.png', 0, 83, 123, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924942_120ce7563b07ecfaea31fdf32c1a51e1_rle_crop_3994414724_0.png', 0, 80, 107, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924942_120ce7563b07ecfaea31fdf32c1a51e1_rle_crop_3994414723_0.png', 0, 103, 59, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414727_0.png', 0, 155, 82, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414731_0.png', 0, 53, 57, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414733_0.png', 0, 73, 58, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414732_0.png', 0, 112, 38, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924898_502b8fc306561bcba0b2172df14ac33b_rle_crop_3994414734_0.png', 0, 92, 178, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414735_0.png', 0, 244, 136, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414739_0.png', 0, 165, 146, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414741_0.png', 0, 127, 65, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414740_0.png', 0, 128, 77, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414738_0.png', 0, 103, 106, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414743_0.png', 0, 52, 56, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924604_32bc757d620858261db477e4a069dd0e_rle_crop_3994414749_0.png', 0, 36, 57, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414753_0.png', 0, 42, 59, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414751_0.png', 0, 62, 130, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414759_0.png', 0, 65, 187, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414756_0.png', 0, 104, 156, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414757_0.png', 0, 123, 74, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414760_0.png', 0, 93, 76, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414762_0.png', 0, 50, 71, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414764_0.png', 0, 85, 161, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414763_0.png', 0, 118, 115, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414766_0.png', 0, 95, 90, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414770_0.png', 0, 119, 92, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414774_0.png', 0, 387, 258, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414775_0.png', 0, 90, 115, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178675), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414776_0.png', 0, 94, 67, 0, 1760178675,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.6599702835083 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760178682_2463151 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178683), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414712_0.png', 0, 346, 546, 0, 1760178683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178683), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414718_0.png', 0, 99, 147, 0, 1760178683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178683), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414722_0.png', 0, 75, 138, 0, 1760178683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178683), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414720_0.png', 0, 237, 111, 0, 1760178683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178683), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414744_0.png', 0, 355, 568, 0, 1760178683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178683), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924607_e702d3ada54e72889f566bd4f9df5caa_rle_crop_3994414748_0.png', 0, 333, 512, 0, 1760178683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178683), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414752_0.png', 0, 314, 510, 0, 1760178683,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.6706907749176025 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760178685_2463151 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178685), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414716_0.png', 0, 96, 69, 0, 1760178685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178685), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414773_0.png', 0, 75, 111, 0, 1760178685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178685), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414772_0.png', 0, 76, 99, 0, 1760178685,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0739610195159912 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760178703_2463151 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924961_a08d7bcc6f4c8ec591028199644af2c9_rle_crop_3994414715_0.png', 0, 189, 191, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414721_0.png', 0, 364, 530, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414725_0.png', 0, 263, 111, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414726_0.png', 0, 734, 991, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414730_0.png', 0, 786, 903, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414729_0.png', 0, 598, 244, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414728_0.png', 0, 82, 35, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414737_0.png', 0, 155, 137, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414736_0.png', 0, 295, 516, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414745_0.png', 0, 1347, 983, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414746_0.png', 0, 316, 510, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924607_e702d3ada54e72889f566bd4f9df5caa_rle_crop_3994414747_0.png', 0, 317, 517, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924604_32bc757d620858261db477e4a069dd0e_rle_crop_3994414750_0.png', 0, 328, 527, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414758_0.png', 0, 949, 713, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414755_0.png', 0, 148, 191, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414754_0.png', 0, 58, 66, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414761_0.png', 0, 340, 522, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414768_0.png', 0, 850, 962, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414767_0.png', 0, 94, 178, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924571_680fc857a5ae2a9c1b6e359e1e799dab_rle_crop_3994414769_0.png', 0, 28, 53, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178717), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414771_0.png', 0, 349, 109, 0, 1760178717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 17.26030468940735 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760178720_2463151 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178721), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414742_0.png', 0, 106, 73, 0, 1760178721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8089141845703125 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760178722_2463151 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760178722), 0.0, 0.0, 14, '', 0, 0, '1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414765_0.png', 0, 61, 116, 0, 1760178722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8185229301452637 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1388924964, 1388924961, 1388924959, 1388924956, 1388924942, 1388924938, 1388924936, 1388924932, 1388924898, 1388924689, 1388924674, 1388924667, 1388924607, 1388924604, 1388924601, 1388924599, 1388924596, 1388924593, 1388924578, 1388924574, 1388924571, 1388924569, 1388924566] Looping around the photos to save general results len do output : 67 /1388931926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388931999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924964', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924961', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924959', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924956', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924942', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924938', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924936', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924932', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924898', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924689', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924674', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924667', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924607', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924604', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924601', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924599', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924596', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924593', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924578', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924574', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924571', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924569', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924566', None, None, None, None, None, '3929010') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 224 time used for this insertion : 0.04236960411071777 save_final save missing photos in datou_result : time spend for datou_step_exec : 56.158958435058594 time spend to save output : 0.04457664489746094 total time spend for step 2 : 56.203535079956055 step3:rle_unique_nms_with_priority Sat Oct 11 12:32:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 67 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.1594376564025879 time for calcul the mask position with numpy : 0.03247833251953125 nb_pixel_total : 1944235 time to create 1 rle with new method : 0.4895162582397461 time for calcul the mask position with numpy : 0.007288694381713867 nb_pixel_total : 4286 time to create 1 rle with old method : 0.005068302154541016 time for calcul the mask position with numpy : 0.006838083267211914 nb_pixel_total : 4428 time to create 1 rle with old method : 0.005268573760986328 time for calcul the mask position with numpy : 0.0077953338623046875 nb_pixel_total : 110631 time to create 1 rle with old method : 0.12803173065185547 time for calcul the mask position with numpy : 0.0066986083984375 nb_pixel_total : 5024 time to create 1 rle with old method : 0.005959272384643555 time for calcul the mask position with numpy : 0.007169246673583984 nb_pixel_total : 4996 time to create 1 rle with old method : 0.005797147750854492 create new chi : 0.71701979637146 time to delete rle : 0.06946682929992676 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2864 TO DO : save crop sub photo not yet done ! save time : 0.44680261611938477 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.061295270919799805 time for calcul the mask position with numpy : 0.03476357460021973 nb_pixel_total : 2045747 time to create 1 rle with new method : 0.048858642578125 time for calcul the mask position with numpy : 0.00851297378540039 nb_pixel_total : 27853 time to create 1 rle with old method : 0.0450444221496582 create new chi : 0.1376028060913086 time to delete rle : 0.0004062652587890625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1486 TO DO : save crop sub photo not yet done ! save time : 0.28812694549560547 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.08247089385986328 time for calcul the mask position with numpy : 0.0870363712310791 nb_pixel_total : 2049845 time to create 1 rle with new method : 0.3603086471557617 time for calcul the mask position with numpy : 0.006150960922241211 nb_pixel_total : 2716 time to create 1 rle with old method : 0.003499746322631836 time for calcul the mask position with numpy : 0.006877422332763672 nb_pixel_total : 8478 time to create 1 rle with old method : 0.010034799575805664 time for calcul the mask position with numpy : 0.0059664249420166016 nb_pixel_total : 7193 time to create 1 rle with old method : 0.008299827575683594 time for calcul the mask position with numpy : 0.0062830448150634766 nb_pixel_total : 5368 time to create 1 rle with old method : 0.006304264068603516 create new chi : 0.5088634490966797 time to delete rle : 0.00031566619873046875 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1846 TO DO : save crop sub photo not yet done ! save time : 0.3612515926361084 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.056162357330322266 time for calcul the mask position with numpy : 0.021227359771728516 nb_pixel_total : 1935706 time to create 1 rle with new method : 0.2077169418334961 time for calcul the mask position with numpy : 0.007396697998046875 nb_pixel_total : 6257 time to create 1 rle with old method : 0.008153915405273438 time for calcul the mask position with numpy : 0.007493734359741211 nb_pixel_total : 112833 time to create 1 rle with old method : 0.13810038566589355 time for calcul the mask position with numpy : 0.0068318843841552734 nb_pixel_total : 18804 time to create 1 rle with old method : 0.021910667419433594 create new chi : 0.42602014541625977 time to delete rle : 0.0003581047058105469 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2696 TO DO : save crop sub photo not yet done ! save time : 0.47416186332702637 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.059687137603759766 time for calcul the mask position with numpy : 0.03071880340576172 nb_pixel_total : 2064472 time to create 1 rle with new method : 0.050374746322631836 time for calcul the mask position with numpy : 0.007334232330322266 nb_pixel_total : 4724 time to create 1 rle with old method : 0.005503177642822266 time for calcul the mask position with numpy : 0.006985187530517578 nb_pixel_total : 4404 time to create 1 rle with old method : 0.0051043033599853516 create new chi : 0.11067080497741699 time to delete rle : 0.0003917217254638672 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1412 TO DO : save crop sub photo not yet done ! save time : 0.31768178939819336 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.08672881126403809 time for calcul the mask position with numpy : 0.02739429473876953 nb_pixel_total : 1510266 time to create 1 rle with new method : 0.07371354103088379 time for calcul the mask position with numpy : 0.00733184814453125 nb_pixel_total : 6819 time to create 1 rle with old method : 0.008025169372558594 time for calcul the mask position with numpy : 0.014582633972167969 nb_pixel_total : 533346 time to create 1 rle with new method : 0.04566049575805664 time for calcul the mask position with numpy : 0.007238149642944336 nb_pixel_total : 23169 time to create 1 rle with old method : 0.02583146095275879 create new chi : 0.21701550483703613 time to delete rle : 0.0008556842803955078 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3490 TO DO : save crop sub photo not yet done ! save time : 0.533851146697998 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.0751960277557373 time for calcul the mask position with numpy : 0.024205446243286133 nb_pixel_total : 1548288 time to create 1 rle with new method : 0.055548906326293945 time for calcul the mask position with numpy : 0.010558128356933594 nb_pixel_total : 436863 time to create 1 rle with new method : 0.04107403755187988 time for calcul the mask position with numpy : 0.007550954818725586 nb_pixel_total : 85878 time to create 1 rle with old method : 0.09991335868835449 time for calcul the mask position with numpy : 0.007155179977416992 nb_pixel_total : 2571 time to create 1 rle with old method : 0.0028586387634277344 create new chi : 0.25332188606262207 time to delete rle : 0.0011436939239501953 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4488 TO DO : save crop sub photo not yet done ! save time : 0.5813612937927246 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.08051657676696777 time for calcul the mask position with numpy : 0.035924434661865234 nb_pixel_total : 2065214 time to create 1 rle with new method : 0.06930375099182129 time for calcul the mask position with numpy : 0.0076448917388916016 nb_pixel_total : 2370 time to create 1 rle with old method : 0.0028803348541259766 time for calcul the mask position with numpy : 0.007578372955322266 nb_pixel_total : 3552 time to create 1 rle with old method : 0.004239320755004883 time for calcul the mask position with numpy : 0.007520914077758789 nb_pixel_total : 2464 time to create 1 rle with old method : 0.0029702186584472656 create new chi : 0.14567303657531738 time to delete rle : 0.00039196014404296875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1392 TO DO : save crop sub photo not yet done ! save time : 0.2814037799835205 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04538369178771973 time for calcul the mask position with numpy : 0.03202176094055176 nb_pixel_total : 2064071 time to create 1 rle with new method : 0.054140567779541016 time for calcul the mask position with numpy : 0.007494211196899414 nb_pixel_total : 9529 time to create 1 rle with old method : 0.01136469841003418 create new chi : 0.1109318733215332 time to delete rle : 0.0004076957702636719 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1438 TO DO : save crop sub photo not yet done ! save time : 0.30682373046875 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.08275961875915527 time for calcul the mask position with numpy : 0.03386044502258301 nb_pixel_total : 1950219 time to create 1 rle with new method : 0.3597245216369629 time for calcul the mask position with numpy : 0.007334470748901367 nb_pixel_total : 11728 time to create 1 rle with old method : 0.013457536697387695 time for calcul the mask position with numpy : 0.008268594741821289 nb_pixel_total : 92833 time to create 1 rle with old method : 0.10785841941833496 time for calcul the mask position with numpy : 0.0074405670166015625 nb_pixel_total : 18820 time to create 1 rle with old method : 0.02228999137878418 create new chi : 0.5679111480712891 time to delete rle : 0.00036978721618652344 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2698 TO DO : save crop sub photo not yet done ! save time : 0.48833775520324707 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.13435935974121094 time for calcul the mask position with numpy : 0.03542613983154297 nb_pixel_total : 2046464 time to create 1 rle with new method : 0.36308908462524414 time for calcul the mask position with numpy : 0.007493495941162109 nb_pixel_total : 5733 time to create 1 rle with old method : 0.00679469108581543 time for calcul the mask position with numpy : 0.007386445999145508 nb_pixel_total : 6020 time to create 1 rle with old method : 0.00715184211730957 time for calcul the mask position with numpy : 0.0075473785400390625 nb_pixel_total : 9196 time to create 1 rle with old method : 0.010915756225585938 time for calcul the mask position with numpy : 0.0074748992919921875 nb_pixel_total : 6187 time to create 1 rle with old method : 0.00743865966796875 create new chi : 0.4685788154602051 time to delete rle : 0.0005583763122558594 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 1954 TO DO : save crop sub photo not yet done ! save time : 0.3665454387664795 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.11680865287780762 time for calcul the mask position with numpy : 0.03644251823425293 nb_pixel_total : 903676 time to create 1 rle with new method : 0.24559378623962402 time for calcul the mask position with numpy : 0.007086038589477539 nb_pixel_total : 891 time to create 1 rle with old method : 0.0014467239379882812 time for calcul the mask position with numpy : 0.03893232345581055 nb_pixel_total : 1048291 time to create 1 rle with new method : 0.28030896186828613 time for calcul the mask position with numpy : 0.008168220520019531 nb_pixel_total : 112450 time to create 1 rle with old method : 0.13120079040527344 time for calcul the mask position with numpy : 0.007727384567260742 nb_pixel_total : 2478 time to create 1 rle with old method : 0.002988576889038086 time for calcul the mask position with numpy : 0.007427215576171875 nb_pixel_total : 5814 time to create 1 rle with old method : 0.0070438385009765625 create new chi : 0.7927777767181396 time to delete rle : 0.001447439193725586 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5784 TO DO : save crop sub photo not yet done ! save time : 0.8278064727783203 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04304003715515137 time for calcul the mask position with numpy : 0.021236658096313477 nb_pixel_total : 1970123 time to create 1 rle with new method : 0.05683183670043945 time for calcul the mask position with numpy : 0.007539987564086914 nb_pixel_total : 6760 time to create 1 rle with old method : 0.008327722549438477 time for calcul the mask position with numpy : 0.006863594055175781 nb_pixel_total : 96717 time to create 1 rle with old method : 0.1104886531829834 create new chi : 0.211747407913208 time to delete rle : 0.000293731689453125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2740 TO DO : save crop sub photo not yet done ! save time : 0.424410343170166 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.056304931640625 time for calcul the mask position with numpy : 0.026400327682495117 nb_pixel_total : 1972290 time to create 1 rle with new method : 0.05542755126953125 time for calcul the mask position with numpy : 0.007509708404541016 nb_pixel_total : 99709 time to create 1 rle with old method : 0.13034296035766602 time for calcul the mask position with numpy : 0.006408214569091797 nb_pixel_total : 1601 time to create 1 rle with old method : 0.0019152164459228516 create new chi : 0.23378896713256836 time to delete rle : 0.0004520416259765625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2262 TO DO : save crop sub photo not yet done ! save time : 0.45847487449645996 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.049832820892333984 time for calcul the mask position with numpy : 0.02234673500061035 nb_pixel_total : 1972645 time to create 1 rle with new method : 0.24667119979858398 time for calcul the mask position with numpy : 0.005898475646972656 nb_pixel_total : 2171 time to create 1 rle with old method : 0.0024483203887939453 time for calcul the mask position with numpy : 0.006239414215087891 nb_pixel_total : 93705 time to create 1 rle with old method : 0.1045844554901123 time for calcul the mask position with numpy : 0.00611114501953125 nb_pixel_total : 5079 time to create 1 rle with old method : 0.005841493606567383 create new chi : 0.40714406967163086 time to delete rle : 0.0004432201385498047 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2548 TO DO : save crop sub photo not yet done ! save time : 0.45143604278564453 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.09078001976013184 time for calcul the mask position with numpy : 0.08691239356994629 nb_pixel_total : 1527150 time to create 1 rle with new method : 0.07238936424255371 time for calcul the mask position with numpy : 0.0059719085693359375 nb_pixel_total : 7793 time to create 1 rle with old method : 0.009122848510742188 time for calcul the mask position with numpy : 0.008777379989624023 nb_pixel_total : 496026 time to create 1 rle with new method : 0.3977470397949219 time for calcul the mask position with numpy : 0.005712985992431641 nb_pixel_total : 7809 time to create 1 rle with old method : 0.009178400039672852 time for calcul the mask position with numpy : 0.0059893131256103516 nb_pixel_total : 12890 time to create 1 rle with old method : 0.014726877212524414 time for calcul the mask position with numpy : 0.005926847457885742 nb_pixel_total : 18981 time to create 1 rle with old method : 0.021497011184692383 time for calcul the mask position with numpy : 0.005777120590209961 nb_pixel_total : 2951 time to create 1 rle with old method : 0.003548860549926758 create new chi : 0.6625137329101562 time to delete rle : 0.0006749629974365234 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 4164 TO DO : save crop sub photo not yet done ! save time : 0.6035115718841553 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.048972368240356445 time for calcul the mask position with numpy : 0.018752098083496094 nb_pixel_total : 1957814 time to create 1 rle with new method : 0.029407024383544922 time for calcul the mask position with numpy : 0.006432294845581055 nb_pixel_total : 3094 time to create 1 rle with old method : 0.003735065460205078 time for calcul the mask position with numpy : 0.0064945220947265625 nb_pixel_total : 107169 time to create 1 rle with old method : 0.12642264366149902 time for calcul the mask position with numpy : 0.005823373794555664 nb_pixel_total : 5523 time to create 1 rle with old method : 0.006154775619506836 create new chi : 0.209794282913208 time to delete rle : 0.0004341602325439453 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2420 TO DO : save crop sub photo not yet done ! save time : 0.38681650161743164 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.047621965408325195 time for calcul the mask position with numpy : 0.0303494930267334 nb_pixel_total : 2055178 time to create 1 rle with new method : 0.21558880805969238 time for calcul the mask position with numpy : 0.0057811737060546875 nb_pixel_total : 5126 time to create 1 rle with old method : 0.005822420120239258 time for calcul the mask position with numpy : 0.005956888198852539 nb_pixel_total : 5373 time to create 1 rle with old method : 0.0062656402587890625 time for calcul the mask position with numpy : 0.005936384201049805 nb_pixel_total : 7923 time to create 1 rle with old method : 0.009046554565429688 create new chi : 0.29100918769836426 time to delete rle : 0.00033211708068847656 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1864 TO DO : save crop sub photo not yet done ! save time : 0.3224608898162842 No data in photo_id : 1388924578 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05072474479675293 time for calcul the mask position with numpy : 0.0167233943939209 nb_pixel_total : 1458965 time to create 1 rle with new method : 0.05235576629638672 time for calcul the mask position with numpy : 0.010221242904663086 nb_pixel_total : 598119 time to create 1 rle with new method : 0.03704977035522461 time for calcul the mask position with numpy : 0.005895137786865234 nb_pixel_total : 10673 time to create 1 rle with old method : 0.012290000915527344 time for calcul the mask position with numpy : 0.005774021148681641 nb_pixel_total : 5843 time to create 1 rle with old method : 0.006608247756958008 create new chi : 0.15299558639526367 time to delete rle : 0.0005030632019042969 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3442 TO DO : save crop sub photo not yet done ! save time : 0.49116992950439453 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.035321950912475586 time for calcul the mask position with numpy : 0.01974320411682129 nb_pixel_total : 2072466 time to create 1 rle with new method : 0.039589643478393555 time for calcul the mask position with numpy : 0.006063699722290039 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0014770030975341797 create new chi : 0.07118058204650879 time to delete rle : 0.00021982192993164062 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1186 TO DO : save crop sub photo not yet done ! save time : 0.31597018241882324 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.05986499786376953 time for calcul the mask position with numpy : 0.19304704666137695 nb_pixel_total : 2027278 time to create 1 rle with new method : 0.07415652275085449 time for calcul the mask position with numpy : 0.006112575531005859 nb_pixel_total : 5036 time to create 1 rle with old method : 0.005754232406616211 time for calcul the mask position with numpy : 0.006316184997558594 nb_pixel_total : 6333 time to create 1 rle with old method : 0.006894111633300781 time for calcul the mask position with numpy : 0.006292819976806641 nb_pixel_total : 28264 time to create 1 rle with old method : 0.03444385528564453 time for calcul the mask position with numpy : 0.006453037261962891 nb_pixel_total : 6689 time to create 1 rle with old method : 0.007600307464599609 create new chi : 0.3557014465332031 time to delete rle : 0.0004000663757324219 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 1952 TO DO : save crop sub photo not yet done ! save time : 0.3633589744567871 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05730891227722168 time for calcul the mask position with numpy : 0.01869964599609375 nb_pixel_total : 1992428 time to create 1 rle with new method : 0.22210383415222168 time for calcul the mask position with numpy : 0.005843162536621094 nb_pixel_total : 4095 time to create 1 rle with old method : 0.004633188247680664 time for calcul the mask position with numpy : 0.005689144134521484 nb_pixel_total : 6528 time to create 1 rle with old method : 0.0071887969970703125 time for calcul the mask position with numpy : 0.005797624588012695 nb_pixel_total : 70549 time to create 1 rle with old method : 0.07584047317504883 create new chi : 0.35030198097229004 time to delete rle : 0.00032210350036621094 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1962 TO DO : save crop sub photo not yet done ! save time : 0.3603951930999756 map_output_result : {1388924964: (0.0, 'Should be the crop_list due to order', 0), 1388924961: (0.0, 'Should be the crop_list due to order', 0), 1388924959: (0.0, 'Should be the crop_list due to order', 0), 1388924956: (0.0, 'Should be the crop_list due to order', 0), 1388924942: (0.0, 'Should be the crop_list due to order', 0), 1388924938: (0.0, 'Should be the crop_list due to order', 0), 1388924936: (0.0, 'Should be the crop_list due to order', 0), 1388924932: (0.0, 'Should be the crop_list due to order', 0), 1388924898: (0.0, 'Should be the crop_list due to order', 0), 1388924689: (0.0, 'Should be the crop_list due to order', 0), 1388924674: (0.0, 'Should be the crop_list due to order', 0), 1388924667: (0.0, 'Should be the crop_list due to order', 0), 1388924607: (0.0, 'Should be the crop_list due to order', 0), 1388924604: (0.0, 'Should be the crop_list due to order', 0), 1388924601: (0.0, 'Should be the crop_list due to order', 0), 1388924599: (0.0, 'Should be the crop_list due to order', 0), 1388924596: (0.0, 'Should be the crop_list due to order', 0), 1388924593: (0.0, 'Should be the crop_list due to order', 0), 1388924578: (0.0, 'Should be the crop_list due to order', 0.0), 1388924574: (0.0, 'Should be the crop_list due to order', 0), 1388924571: (0.0, 'Should be the crop_list due to order', 0), 1388924569: (0.0, 'Should be the crop_list due to order', 0), 1388924566: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1388924964, 1388924961, 1388924959, 1388924956, 1388924942, 1388924938, 1388924936, 1388924932, 1388924898, 1388924689, 1388924674, 1388924667, 1388924607, 1388924604, 1388924601, 1388924599, 1388924596, 1388924593, 1388924578, 1388924574, 1388924571, 1388924569, 1388924566] Looping around the photos to save general results len do output : 23 /1388924964.Didn't retrieve data . /1388924961.Didn't retrieve data . /1388924959.Didn't retrieve data . /1388924956.Didn't retrieve data . /1388924942.Didn't retrieve data . /1388924938.Didn't retrieve data . /1388924936.Didn't retrieve data . /1388924932.Didn't retrieve data . /1388924898.Didn't retrieve data . /1388924689.Didn't retrieve data . /1388924674.Didn't retrieve data . /1388924667.Didn't retrieve data . /1388924607.Didn't retrieve data . /1388924604.Didn't retrieve data . /1388924601.Didn't retrieve data . /1388924599.Didn't retrieve data . /1388924596.Didn't retrieve data . /1388924593.Didn't retrieve data . /1388924578.Didn't retrieve data . /1388924574.Didn't retrieve data . /1388924571.Didn't retrieve data . /1388924569.Didn't retrieve data . /1388924566.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924964', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924961', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924959', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924956', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924942', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924938', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924936', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924932', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924898', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924689', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924674', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924667', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924607', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924604', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924601', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924599', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924596', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924593', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924578', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924574', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924571', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924569', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924566', None, None, None, None, None, '3929010') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.036470890045166016 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.332467555999756 time spend to save output : 0.03752636909484863 total time spend for step 3 : 19.369993925094604 step4:ventilate_hashtags_in_portfolio Sat Oct 11 12:32:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27729545 get user id for portfolio 27729545 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27729545 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_clair','pehd','pet_fonce','background','carton','papier','metal','flou','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27729545 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_clair','pehd','pet_fonce','background','carton','papier','metal','flou','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27729545 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_clair','pehd','pet_fonce','background','carton','papier','metal','flou','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27729639,27729640,27729641,27729642,27729643,27729644,27729645,27729647,27729648,27729649,27729650?tags=environnement,pet_clair,pehd,pet_fonce,background,carton,papier,metal,flou,mal_croppe,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1388924964, 1388924961, 1388924959, 1388924956, 1388924942, 1388924938, 1388924936, 1388924932, 1388924898, 1388924689, 1388924674, 1388924667, 1388924607, 1388924604, 1388924601, 1388924599, 1388924596, 1388924593, 1388924578, 1388924574, 1388924571, 1388924569, 1388924566] Looping around the photos to save general results len do output : 1 /27729545. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924964', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924961', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924959', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924956', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924942', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924938', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924936', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924932', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924898', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924689', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924674', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924667', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924607', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924604', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924601', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924599', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924596', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924593', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924578', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924574', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924571', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924569', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924566', None, None, None, None, None, '3929010') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.04123401641845703 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.552860498428345 time spend to save output : 0.0415956974029541 total time spend for step 4 : 5.594456195831299 step5:final Sat Oct 11 12:32:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1388924964: ('0.09403222289318301',), 1388924961: ('0.09403222289318301',), 1388924959: ('0.09403222289318301',), 1388924956: ('0.09403222289318301',), 1388924942: ('0.09403222289318301',), 1388924938: ('0.09403222289318301',), 1388924936: ('0.09403222289318301',), 1388924932: ('0.09403222289318301',), 1388924898: ('0.09403222289318301',), 1388924689: ('0.09403222289318301',), 1388924674: ('0.09403222289318301',), 1388924667: ('0.09403222289318301',), 1388924607: ('0.09403222289318301',), 1388924604: ('0.09403222289318301',), 1388924601: ('0.09403222289318301',), 1388924599: ('0.09403222289318301',), 1388924596: ('0.09403222289318301',), 1388924593: ('0.09403222289318301',), 1388924578: ('0.09403222289318301',), 1388924574: ('0.09403222289318301',), 1388924571: ('0.09403222289318301',), 1388924569: ('0.09403222289318301',), 1388924566: ('0.09403222289318301',)} new output for save of step final : {1388924964: ('0.09403222289318301',), 1388924961: ('0.09403222289318301',), 1388924959: ('0.09403222289318301',), 1388924956: ('0.09403222289318301',), 1388924942: ('0.09403222289318301',), 1388924938: ('0.09403222289318301',), 1388924936: ('0.09403222289318301',), 1388924932: ('0.09403222289318301',), 1388924898: ('0.09403222289318301',), 1388924689: ('0.09403222289318301',), 1388924674: ('0.09403222289318301',), 1388924667: ('0.09403222289318301',), 1388924607: ('0.09403222289318301',), 1388924604: ('0.09403222289318301',), 1388924601: ('0.09403222289318301',), 1388924599: ('0.09403222289318301',), 1388924596: ('0.09403222289318301',), 1388924593: ('0.09403222289318301',), 1388924578: ('0.09403222289318301',), 1388924574: ('0.09403222289318301',), 1388924571: ('0.09403222289318301',), 1388924569: ('0.09403222289318301',), 1388924566: ('0.09403222289318301',)} [1388924964, 1388924961, 1388924959, 1388924956, 1388924942, 1388924938, 1388924936, 1388924932, 1388924898, 1388924689, 1388924674, 1388924667, 1388924607, 1388924604, 1388924601, 1388924599, 1388924596, 1388924593, 1388924578, 1388924574, 1388924571, 1388924569, 1388924566] Looping around the photos to save general results len do output : 23 /1388924964.Didn't retrieve data . /1388924961.Didn't retrieve data . /1388924959.Didn't retrieve data . /1388924956.Didn't retrieve data . /1388924942.Didn't retrieve data . /1388924938.Didn't retrieve data . /1388924936.Didn't retrieve data . /1388924932.Didn't retrieve data . /1388924898.Didn't retrieve data . /1388924689.Didn't retrieve data . /1388924674.Didn't retrieve data . /1388924667.Didn't retrieve data . /1388924607.Didn't retrieve data . /1388924604.Didn't retrieve data . /1388924601.Didn't retrieve data . /1388924599.Didn't retrieve data . /1388924596.Didn't retrieve data . /1388924593.Didn't retrieve data . /1388924578.Didn't retrieve data . /1388924574.Didn't retrieve data . /1388924571.Didn't retrieve data . /1388924569.Didn't retrieve data . /1388924566.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924964', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924961', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924959', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924956', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924942', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924938', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924936', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924932', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924898', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924689', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924674', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924667', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924607', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924604', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924601', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924599', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924596', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924593', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924578', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924574', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924571', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924569', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924566', None, None, None, None, None, '3929010') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.03849363327026367 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.382368803024292 time spend to save output : 0.03983449935913086 total time spend for step 5 : 0.42220330238342285 step6:blur_detection Sat Oct 11 12:32:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd.jpg resize: (1080, 1920) 1388924964 -4.041027071401029 treat image : temp/1760178631_2463151_1388924961_a08d7bcc6f4c8ec591028199644af2c9.jpg resize: (1080, 1920) 1388924961 -0.36278463286806323 treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1.jpg resize: (1080, 1920) 1388924959 1.3986926282339152 treat image : temp/1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de.jpg resize: (1080, 1920) 1388924956 1.5152564064449359 treat image : temp/1760178631_2463151_1388924942_120ce7563b07ecfaea31fdf32c1a51e1.jpg resize: (1080, 1920) 1388924942 -0.7019369223737201 treat image : temp/1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1.jpg resize: (1080, 1920) 1388924938 -2.6601924319287105 treat image : temp/1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f.jpg resize: (1080, 1920) 1388924936 -0.7454020945153663 treat image : temp/1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8.jpg resize: (1080, 1920) 1388924932 -4.643451505802044 treat image : temp/1760178631_2463151_1388924898_502b8fc306561bcba0b2172df14ac33b.jpg resize: (1080, 1920) 1388924898 0.7580909466459529 treat image : temp/1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc.jpg resize: (1080, 1920) 1388924689 -4.707260668496491 treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb.jpg resize: (1080, 1920) 1388924674 0.14983324629511985 treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b.jpg resize: (1080, 1920) 1388924667 -3.972870916676324 treat image : temp/1760178631_2463151_1388924607_e702d3ada54e72889f566bd4f9df5caa.jpg resize: (1080, 1920) 1388924607 -3.70863631846361 treat image : temp/1760178631_2463151_1388924604_32bc757d620858261db477e4a069dd0e.jpg resize: (1080, 1920) 1388924604 -3.741371602508162 treat image : temp/1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951.jpg resize: (1080, 1920) 1388924601 0.4763439820958075 treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797.jpg resize: (1080, 1920) 1388924599 -2.970187350398511 treat image : temp/1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6.jpg resize: (1080, 1920) 1388924596 -4.28836895835696 treat image : temp/1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee.jpg resize: (1080, 1920) 1388924593 -0.3189536378686809 treat image : temp/1760178631_2463151_1388924578_3227faeed307a0c1ebf8f9d47d1ec980.jpg resize: (1080, 1920) 1388924578 1.4738267248903383 treat image : temp/1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438.jpg resize: (1080, 1920) 1388924574 1.4134851518751828 treat image : temp/1760178631_2463151_1388924571_680fc857a5ae2a9c1b6e359e1e799dab.jpg resize: (1080, 1920) 1388924571 0.25636452486818817 treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b.jpg resize: (1080, 1920) 1388924569 0.05287500136637819 treat image : temp/1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808.jpg resize: (1080, 1920) 1388924566 -1.370356854098942 treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414714_0.png resize: (78, 73) 1388931926 -0.0881197002775829 treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414713_0.png resize: (75, 90) 1388931927 -1.0859943188409962 treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414710_0.png resize: (60, 117) 1388931928 -0.6041333043422016 treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414711_0.png resize: (59, 131) 1388931929 -3.1220370907271535 treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414719_0.png resize: (44, 74) 1388931930 5.352226424468622 treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414717_0.png resize: (123, 83) 1388931931 -0.6993579699216094 treat image : temp/1760178631_2463151_1388924942_120ce7563b07ecfaea31fdf32c1a51e1_rle_crop_3994414724_0.png resize: (107, 80) 1388931932 -1.4301797546054542 treat image : temp/1760178631_2463151_1388924942_120ce7563b07ecfaea31fdf32c1a51e1_rle_crop_3994414723_0.png resize: (59, 103) 1388931933 -0.599163999724203 treat image : temp/1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414727_0.png resize: (82, 155) 1388931934 -1.2031799427653265 treat image : temp/1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414731_0.png resize: (57, 53) 1388931935 -2.6810743588214545 treat image : temp/1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414733_0.png resize: (58, 73) 1388931936 -3.500708853396299 treat image : temp/1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414732_0.png resize: (38, 112) 1388931937 -0.7617945550842755 treat image : temp/1760178631_2463151_1388924898_502b8fc306561bcba0b2172df14ac33b_rle_crop_3994414734_0.png resize: (178, 92) 1388931938 -0.8447234048969263 treat image : temp/1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414735_0.png resize: (136, 244) 1388931939 -4.646724751931319 treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414739_0.png resize: (146, 165) 1388931940 -1.5764548280088164 treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414741_0.png resize: (65, 127) 1388931941 -0.08179907948711615 treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414740_0.png resize: (77, 128) 1388931942 -1.1881537927989498 treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414738_0.png resize: (106, 103) 1388931943 -0.7251047476126268 treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414743_0.png resize: (56, 52) 1388931944 0.24239371741349447 treat image : temp/1760178631_2463151_1388924604_32bc757d620858261db477e4a069dd0e_rle_crop_3994414749_0.png resize: (57, 36) 1388931945 20.0 treat image : temp/1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414753_0.png resize: (59, 42) 1388931946 20.0 treat image : temp/1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414751_0.png resize: (130, 62) 1388931947 0.6708059705656269 treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414759_0.png resize: (187, 65) 1388931948 -1.2065779004295603 treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414756_0.png resize: (156, 104) 1388931949 -3.295883503438677 treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414757_0.png resize: (74, 123) 1388931950 -2.114474102477806 treat image : temp/1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414760_0.png resize: (76, 93) 1388931951 -1.6455756307141605 treat image : temp/1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414762_0.png resize: (71, 50) 1388931952 4.0402110357460765 treat image : temp/1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414764_0.png resize: (161, 85) 1388931953 -2.677912147676349 treat image : temp/1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414763_0.png resize: (115, 118) 1388931954 -1.562983379492884 treat image : temp/1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414766_0.png resize: (90, 95) 1388931955 0.5892350494033789 treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414770_0.png resize: (92, 119) 1388931956 -0.5366288636295095 treat image : temp/1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414774_0.png resize: (258, 387) 1388931957 -0.9889191666227174 treat image : temp/1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414775_0.png resize: (115, 90) 1388931958 -0.9553077860684869 treat image : temp/1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414776_0.png resize: (67, 94) 1388931959 -1.8520155894595907 treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414712_0.png resize: (546, 346) 1388931964 -0.21892554437792344 treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414718_0.png resize: (147, 99) 1388931965 -1.8279280357360166 treat image : temp/1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414722_0.png resize: (138, 75) 1388931966 -1.5812151772482115 treat image : temp/1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414720_0.png resize: (111, 237) 1388931967 -1.5550231986729124 treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414744_0.png resize: (568, 355) 1388931969 -0.26969035487958676 treat image : temp/1760178631_2463151_1388924607_e702d3ada54e72889f566bd4f9df5caa_rle_crop_3994414748_0.png resize: (512, 333) 1388931970 -0.21653930644573127 treat image : temp/1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414752_0.png resize: (510, 314) 1388931971 -0.4986494335815501 treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414716_0.png resize: (69, 96) 1388931974 -0.3468345843854119 treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414773_0.png resize: (111, 75) 1388931975 -1.9819744143271005 treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414772_0.png resize: (99, 76) 1388931976 1.4452712333729811 treat image : temp/1760178631_2463151_1388924961_a08d7bcc6f4c8ec591028199644af2c9_rle_crop_3994414715_0.png resize: (191, 189) 1388931984 -2.6169804472067906 treat image : temp/1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414721_0.png resize: (530, 364) 1388931985 -0.0740719113675861 treat image : temp/1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414725_0.png resize: (111, 263) 1388931986 -2.3073044939994145 treat image : temp/1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414726_0.png resize: (991, 734) 1388931987 -0.5699637996304333 treat image : temp/1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414730_0.png resize: (903, 786) 1388931988 -0.17536698135151862 treat image : temp/1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414729_0.png resize: (244, 598) 1388931989 -3.312790827690456 treat image : temp/1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414728_0.png resize: (35, 82) 1388931990 -0.5677457927080379 treat image : temp/1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414737_0.png resize: (137, 155) 1388931991 -4.67350124337773 treat image : temp/1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414736_0.png resize: (516, 295) 1388931992 0.11513173735054738 treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414745_0.png resize: (983, 1347) 1388931993 -3.2783224024553723 treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414746_0.png resize: (510, 316) 1388931994 0.24510478243272382 treat image : temp/1760178631_2463151_1388924607_e702d3ada54e72889f566bd4f9df5caa_rle_crop_3994414747_0.png resize: (517, 317) 1388931995 0.14440822386520544 treat image : temp/1760178631_2463151_1388924604_32bc757d620858261db477e4a069dd0e_rle_crop_3994414750_0.png resize: (527, 328) 1388931996 0.2375520977722117 treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414758_0.png resize: (713, 949) 1388931997 0.37754852667258454 treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414755_0.png resize: (191, 148) 1388931998 -2.3287678075070817 treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414754_0.png resize: (66, 58) 1388931999 0.4437718127898568 treat image : temp/1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414761_0.png resize: (522, 340) 1388932000 -0.12137611891534915 treat image : temp/1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414768_0.png resize: (962, 850) 1388932001 1.022010081458719 treat image : temp/1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414767_0.png resize: (178, 94) 1388932002 -0.021304446771675572 treat image : temp/1760178631_2463151_1388924571_680fc857a5ae2a9c1b6e359e1e799dab_rle_crop_3994414769_0.png resize: (53, 28) 1388932003 -0.7549603610247123 treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414771_0.png resize: (109, 349) 1388932004 -0.1522650912636789 treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414742_0.png resize: (73, 106) 1388932005 -0.8257147577136915 treat image : temp/1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414765_0.png resize: (116, 61) 1388932006 -0.9475499907186408 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.03752398490905762 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.03797006607055664 save missing photos in datou_result : time spend for datou_step_exec : 20.749545335769653 time spend to save output : 0.09338736534118652 total time spend for step 6 : 20.84293270111084 step7:brightness Sat Oct 11 12:32:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd.jpg treat image : temp/1760178631_2463151_1388924961_a08d7bcc6f4c8ec591028199644af2c9.jpg treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1.jpg treat image : temp/1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de.jpg treat image : temp/1760178631_2463151_1388924942_120ce7563b07ecfaea31fdf32c1a51e1.jpg treat image : temp/1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1.jpg treat image : temp/1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f.jpg treat image : temp/1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8.jpg treat image : temp/1760178631_2463151_1388924898_502b8fc306561bcba0b2172df14ac33b.jpg treat image : temp/1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc.jpg treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb.jpg treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b.jpg treat image : temp/1760178631_2463151_1388924607_e702d3ada54e72889f566bd4f9df5caa.jpg treat image : temp/1760178631_2463151_1388924604_32bc757d620858261db477e4a069dd0e.jpg treat image : temp/1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951.jpg treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797.jpg treat image : temp/1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6.jpg treat image : temp/1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee.jpg treat image : temp/1760178631_2463151_1388924578_3227faeed307a0c1ebf8f9d47d1ec980.jpg treat image : temp/1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438.jpg treat image : temp/1760178631_2463151_1388924571_680fc857a5ae2a9c1b6e359e1e799dab.jpg treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b.jpg treat image : temp/1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808.jpg treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414714_0.png treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414713_0.png treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414710_0.png treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414711_0.png treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414719_0.png treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414717_0.png treat image : temp/1760178631_2463151_1388924942_120ce7563b07ecfaea31fdf32c1a51e1_rle_crop_3994414724_0.png treat image : temp/1760178631_2463151_1388924942_120ce7563b07ecfaea31fdf32c1a51e1_rle_crop_3994414723_0.png treat image : temp/1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414727_0.png treat image : temp/1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414731_0.png treat image : temp/1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414733_0.png treat image : temp/1760178631_2463151_1388924932_cec18b1bd24c513e438fa60a8da19ab8_rle_crop_3994414732_0.png treat image : temp/1760178631_2463151_1388924898_502b8fc306561bcba0b2172df14ac33b_rle_crop_3994414734_0.png treat image : temp/1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414735_0.png treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414739_0.png treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414741_0.png treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414740_0.png treat image : temp/1760178631_2463151_1388924674_cea1e0461cae4da542bb24d05fad0adb_rle_crop_3994414738_0.png treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414743_0.png treat image : temp/1760178631_2463151_1388924604_32bc757d620858261db477e4a069dd0e_rle_crop_3994414749_0.png treat image : temp/1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414753_0.png treat image : temp/1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414751_0.png treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414759_0.png treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414756_0.png treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414757_0.png treat image : temp/1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414760_0.png treat image : temp/1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414762_0.png treat image : temp/1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414764_0.png treat image : temp/1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414763_0.png treat image : temp/1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414766_0.png treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414770_0.png treat image : temp/1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414774_0.png treat image : temp/1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414775_0.png treat image : temp/1760178631_2463151_1388924566_f91e0f2b7883fefda0e68fad95d43808_rle_crop_3994414776_0.png treat image : temp/1760178631_2463151_1388924964_3385171dfbfb152c2ef0b49d3a93b5bd_rle_crop_3994414712_0.png treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414718_0.png treat image : temp/1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414722_0.png treat image : temp/1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414720_0.png treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414744_0.png treat image : temp/1760178631_2463151_1388924607_e702d3ada54e72889f566bd4f9df5caa_rle_crop_3994414748_0.png treat image : temp/1760178631_2463151_1388924601_f1634a0e58cbdbf994d4d02831f15951_rle_crop_3994414752_0.png treat image : temp/1760178631_2463151_1388924959_9459e53350778437319ab3ec2e0232f1_rle_crop_3994414716_0.png treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414773_0.png treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414772_0.png treat image : temp/1760178631_2463151_1388924961_a08d7bcc6f4c8ec591028199644af2c9_rle_crop_3994414715_0.png treat image : temp/1760178631_2463151_1388924956_8aa07ee56435ce14ba2748e9f28501de_rle_crop_3994414721_0.png treat image : temp/1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414725_0.png treat image : temp/1760178631_2463151_1388924938_25d4e59f0ecf74dbc05a9e63320cb3e1_rle_crop_3994414726_0.png treat image : temp/1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414730_0.png treat image : temp/1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414729_0.png treat image : temp/1760178631_2463151_1388924936_6e72eedb94112563e28df3dfe5a5274f_rle_crop_3994414728_0.png treat image : temp/1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414737_0.png treat image : temp/1760178631_2463151_1388924689_009939aa8bd15d4201170bd4b54fdcbc_rle_crop_3994414736_0.png treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414745_0.png treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414746_0.png treat image : temp/1760178631_2463151_1388924607_e702d3ada54e72889f566bd4f9df5caa_rle_crop_3994414747_0.png treat image : temp/1760178631_2463151_1388924604_32bc757d620858261db477e4a069dd0e_rle_crop_3994414750_0.png treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414758_0.png treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414755_0.png treat image : temp/1760178631_2463151_1388924599_9a47715821e8b25f29569b9fcd525797_rle_crop_3994414754_0.png treat image : temp/1760178631_2463151_1388924596_f93242984645a998b3e16252ae7f02b6_rle_crop_3994414761_0.png treat image : temp/1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414768_0.png treat image : temp/1760178631_2463151_1388924574_41f93965f395ca2448574f35d2567438_rle_crop_3994414767_0.png treat image : temp/1760178631_2463151_1388924571_680fc857a5ae2a9c1b6e359e1e799dab_rle_crop_3994414769_0.png treat image : temp/1760178631_2463151_1388924569_08d890e177c9660ee4b1a2d4fd25894b_rle_crop_3994414771_0.png treat image : temp/1760178631_2463151_1388924667_6ff014c533a5a79d7da01b0656889a4b_rle_crop_3994414742_0.png treat image : temp/1760178631_2463151_1388924593_aed91ea670ca81dc2b883a9f11e659ee_rle_crop_3994414765_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.0406641960144043 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.03773617744445801 save missing photos in datou_result : time spend for datou_step_exec : 5.786713123321533 time spend to save output : 0.0964665412902832 total time spend for step 7 : 5.883179664611816 step8:velours_tree Sat Oct 11 12:32:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09498929977416992 time spend to save output : 3.695487976074219e-05 total time spend for step 8 : 0.09502625465393066 step9:send_mail_cod Sat Oct 11 12:32:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27729545_11-10-2025_12_32_55.pdf 27729640 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277296401760178775 27729641 imagette277296411760178777 27729642 change filename to text .imagette277296421760178777 27729643 imagette277296431760178777 27729644 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277296441760178777 27729645 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277296451760178777 27729647 change filename to text .change filename to text .change filename to text .imagette277296471760178779 27729648 imagette277296481760178779 27729649 imagette277296491760178779 27729650 change filename to text .imagette277296501760178779 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27729545 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27729639,27729640,27729641,27729642,27729643,27729644,27729645,27729647,27729648,27729649,27729650?tags=environnement,pet_clair,pehd,pet_fonce,background,carton,papier,metal,flou,mal_croppe,autre args[1388924964] : ((1388924964, -4.041027071401029, 492609224), (1388924964, 0.4054521949782995, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924961] : ((1388924961, -0.36278463286806323, 492688767), (1388924961, 0.8761043821261189, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924959] : ((1388924959, 1.3986926282339152, 492688767), (1388924959, 0.13304944947249292, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924956] : ((1388924956, 1.5152564064449359, 492688767), (1388924956, 0.29524498406848987, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924942] : ((1388924942, -0.7019369223737201, 492688767), (1388924942, 0.7049770388705418, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924938] : ((1388924938, -2.6601924319287105, 492609224), (1388924938, 1.7092999590207323, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924936] : ((1388924936, -0.7454020945153663, 492688767), (1388924936, 1.2283046769289883, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924932] : ((1388924932, -4.643451505802044, 492609224), (1388924932, 0.45900292561660494, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924898] : ((1388924898, 0.7580909466459529, 492688767), (1388924898, 0.39225763570517025, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924689] : ((1388924689, -4.707260668496491, 492609224), (1388924689, 0.3964259038001408, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924674] : ((1388924674, 0.14983324629511985, 492688767), (1388924674, 0.621137120684573, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924667] : ((1388924667, -3.972870916676324, 492609224), (1388924667, 0.24816803192394307, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924607] : ((1388924607, -3.70863631846361, 492609224), (1388924607, 0.5861344824913111, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924604] : ((1388924604, -3.741371602508162, 492609224), (1388924604, 0.4516203390519986, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924601] : ((1388924601, 0.4763439820958075, 492688767), (1388924601, 0.36546374525956815, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924599] : ((1388924599, -2.970187350398511, 492609224), (1388924599, 0.7017876591709563, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924596] : ((1388924596, -4.28836895835696, 492609224), (1388924596, 0.18563499366633657, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924593] : ((1388924593, -0.3189536378686809, 492688767), (1388924593, 0.978700363871307, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924578] : ((1388924578, 1.4738267248903383, 492688767), (1388924578, 0.49343289492501663, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924574] : ((1388924574, 1.4134851518751828, 492688767), (1388924574, 0.7548272860506923, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924571] : ((1388924571, 0.25636452486818817, 492688767), (1388924571, 0.683186143870008, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924569] : ((1388924569, 0.05287500136637819, 492688767), (1388924569, 0.8428762267748994, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com args[1388924566] : ((1388924566, -1.370356854098942, 492688767), (1388924566, 0.8730554037601334, 2107752395), '0.09403222289318301') We are sending mail with results at report@fotonower.com refus_total : 0.09403222289318301 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27729545 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729545_11-10-2025_12_32_55.pdf results_Auto_P27729545_11-10-2025_12_32_55.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729545_11-10-2025_12_32_55.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27729545','results_Auto_P27729545_11-10-2025_12_32_55.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729545_11-10-2025_12_32_55.pdf','pdf','','0.63','0.09403222289318301') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27729545

https://www.fotonower.com/image?json=false&list_photos_id=1388924964
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924961
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924959
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3986926282339152)
https://www.fotonower.com/image?json=false&list_photos_id=1388924956
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5152564064449359)
https://www.fotonower.com/image?json=false&list_photos_id=1388924942
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924938
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924936
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924932
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924898
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924689
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924674
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924667
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924607
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924604
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924601
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924599
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924596
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924593
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924578
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4738267248903383)
https://www.fotonower.com/image?json=false&list_photos_id=1388924574
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4134851518751828)
https://www.fotonower.com/image?json=false&list_photos_id=1388924571
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924569
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388924566
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.40%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/27729640?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27729642?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27729644?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27729645?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27729647?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27729650?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729545_11-10-2025_12_32_55.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27729639,27729640,27729641,27729642,27729643,27729644,27729645,27729647,27729648,27729649,27729650?tags=environnement,pet_clair,pehd,pet_fonce,background,carton,papier,metal,flou,mal_croppe,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Sat, 11 Oct 2025 10:33:02 GMT Content-Length: 0 Connection: close X-Message-Id: 0XqXFapySlSUCMR3QC30ZQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1388924964, 1388924961, 1388924959, 1388924956, 1388924942, 1388924938, 1388924936, 1388924932, 1388924898, 1388924689, 1388924674, 1388924667, 1388924607, 1388924604, 1388924601, 1388924599, 1388924596, 1388924593, 1388924578, 1388924574, 1388924571, 1388924569, 1388924566] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924964', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924961', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924959', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924956', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924942', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924938', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924936', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924932', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924898', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924689', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924674', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924667', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924607', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924604', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924601', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924599', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924596', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924593', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924578', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924574', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924571', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924569', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924566', None, None, None, None, None, '3929010') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.04405093193054199 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.633009672164917 time spend to save output : 0.04441499710083008 total time spend for step 9 : 7.677424669265747 step10:split_time_score Sat Oct 11 12:33:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 23),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11102025 27729545 Nombre de photos uploadées : 23 / 23040 (0%) 11102025 27729545 Nombre de photos taguées (types de déchets): 0 / 23 (0%) 11102025 27729545 Nombre de photos taguées (volume) : 0 / 23 (0%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.2159347534179688e-05 ??????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0011453628540039062 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6600706577301025 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.12240318060094409 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27724672_11-10-2025_08_42_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27724672 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27724672 AND mptpi.`type`=3594 To do Qualite : 0.09397649819958848 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27727083_11-10-2025_10_51_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27727083 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27727083 AND mptpi.`type`=3594 To do Qualite : 0.06454658564814812 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27727085_11-10-2025_10_42_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27727085 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27727085 AND mptpi.`type`=3594 To do Qualite : 0.19200231481481483 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27727917_11-10-2025_11_11_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27727917 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27727917 AND mptpi.`type`=3594 To do Qualite : 0.09403222289318301 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729545_11-10-2025_12_32_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27729545 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27729545 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11102025': {'nb_upload': 23, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1388924964, 1388924961, 1388924959, 1388924956, 1388924942, 1388924938, 1388924936, 1388924932, 1388924898, 1388924689, 1388924674, 1388924667, 1388924607, 1388924604, 1388924601, 1388924599, 1388924596, 1388924593, 1388924578, 1388924574, 1388924571, 1388924569, 1388924566] Looping around the photos to save general results len do output : 1 /27729545Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924964', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924961', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924959', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924956', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924942', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924938', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924936', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924932', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924898', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924689', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924674', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924667', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924607', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924604', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924601', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924599', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924596', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924593', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924578', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924574', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924571', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924569', None, None, None, None, None, '3929010') ('3318', None, None, None, None, None, None, None, '3929010') ('3318', '27729545', '1388924566', None, None, None, None, None, '3929010') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.03798198699951172 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2799134254455566 time spend to save output : 0.038292646408081055 total time spend for step 10 : 2.3182060718536377 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 23 set_done_treatment 76.13user 24.56system 2:38.91elapsed 63%CPU (0avgtext+0avgdata 2967048maxresident)k 635184inputs+49704outputs (1421major+1861001minor)pagefaults 0swaps