python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 376531 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3795031'] with mtr_portfolio_ids : ['27355643'] and first list_photo_ids : [] new path : /proc/376531/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 21 ; length of list_pids : 21 ; length of list_args : 21 time to download the photos : 3.7535345554351807 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Sep 30 17:10:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10582 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-30 17:10:35.657330: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-30 17:10:35.684603: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-30 17:10:35.686824: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe2c4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-30 17:10:35.686885: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-30 17:10:35.691063: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-30 17:10:35.873730: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x41e2060 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-30 17:10:35.873799: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-30 17:10:35.875356: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-30 17:10:35.876507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-30 17:10:35.880545: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-30 17:10:35.884170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-30 17:10:35.884788: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-30 17:10:35.888108: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-30 17:10:35.889330: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-30 17:10:35.896130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-30 17:10:35.897865: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-30 17:10:35.897963: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-30 17:10:35.898707: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-30 17:10:35.898722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-30 17:10:35.898730: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-30 17:10:35.900032: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9801 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-30 17:10:36.355420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-30 17:10:36.355546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-30 17:10:36.356204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-30 17:10:36.356225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-30 17:10:36.356240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-30 17:10:36.356254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-30 17:10:36.356269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-30 17:10:36.356284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-30 17:10:36.357676: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-30 17:10:36.358996: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-30 17:10:36.359047: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-30 17:10:36.359064: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-30 17:10:36.359078: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-30 17:10:36.359092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-30 17:10:36.359107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-30 17:10:36.359120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-30 17:10:36.359135: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-30 17:10:36.360365: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-30 17:10:36.360399: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-30 17:10:36.360408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-30 17:10:36.360416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-30 17:10:36.361871: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9801 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-30 17:10:44.921148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-30 17:10:45.104482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 21 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 377039 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4172 tf kernel not reseted sub process len(results) : 21 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 21 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8597 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0009171962738037109 nb_pixel_total : 45022 time to create 1 rle with old method : 0.05283713340759277 length of segment : 308 time for calcul the mask position with numpy : 0.0003619194030761719 nb_pixel_total : 15603 time to create 1 rle with old method : 0.019188404083251953 length of segment : 213 time for calcul the mask position with numpy : 0.00017023086547851562 nb_pixel_total : 6626 time to create 1 rle with old method : 0.00788736343383789 length of segment : 130 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 4036 time to create 1 rle with old method : 0.004857540130615234 length of segment : 79 time for calcul the mask position with numpy : 0.0001232624053955078 nb_pixel_total : 4765 time to create 1 rle with old method : 0.005838871002197266 length of segment : 97 time for calcul the mask position with numpy : 0.00041413307189941406 nb_pixel_total : 22700 time to create 1 rle with old method : 0.02784109115600586 length of segment : 150 time for calcul the mask position with numpy : 0.000202178955078125 nb_pixel_total : 7303 time to create 1 rle with old method : 0.008902311325073242 length of segment : 110 time for calcul the mask position with numpy : 0.0019152164459228516 nb_pixel_total : 103193 time to create 1 rle with old method : 0.13134384155273438 length of segment : 527 time for calcul the mask position with numpy : 0.00027489662170410156 nb_pixel_total : 12686 time to create 1 rle with old method : 0.013480186462402344 length of segment : 194 time for calcul the mask position with numpy : 0.0001475811004638672 nb_pixel_total : 4855 time to create 1 rle with old method : 0.005514860153198242 length of segment : 167 time for calcul the mask position with numpy : 0.00014400482177734375 nb_pixel_total : 7042 time to create 1 rle with old method : 0.008255720138549805 length of segment : 112 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 4360 time to create 1 rle with old method : 0.004851818084716797 length of segment : 87 time for calcul the mask position with numpy : 0.00016927719116210938 nb_pixel_total : 3382 time to create 1 rle with old method : 0.0036826133728027344 length of segment : 104 time for calcul the mask position with numpy : 0.0003960132598876953 nb_pixel_total : 13636 time to create 1 rle with old method : 0.014800786972045898 length of segment : 244 time for calcul the mask position with numpy : 0.0002770423889160156 nb_pixel_total : 17062 time to create 1 rle with old method : 0.0188596248626709 length of segment : 89 time for calcul the mask position with numpy : 0.0003273487091064453 nb_pixel_total : 13228 time to create 1 rle with old method : 0.014812946319580078 length of segment : 128 time for calcul the mask position with numpy : 0.00014662742614746094 nb_pixel_total : 6482 time to create 1 rle with old method : 0.007253408432006836 length of segment : 123 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 3113 time to create 1 rle with old method : 0.0037698745727539062 length of segment : 73 time for calcul the mask position with numpy : 0.0019137859344482422 nb_pixel_total : 112334 time to create 1 rle with old method : 0.11615943908691406 length of segment : 551 time for calcul the mask position with numpy : 0.00025773048400878906 nb_pixel_total : 13601 time to create 1 rle with old method : 0.01475977897644043 length of segment : 111 time for calcul the mask position with numpy : 0.0002601146697998047 nb_pixel_total : 11448 time to create 1 rle with old method : 0.011988639831542969 length of segment : 204 time for calcul the mask position with numpy : 0.00012421607971191406 nb_pixel_total : 3610 time to create 1 rle with old method : 0.003912687301635742 length of segment : 113 time for calcul the mask position with numpy : 0.0003199577331542969 nb_pixel_total : 13639 time to create 1 rle with old method : 0.01511073112487793 length of segment : 160 time for calcul the mask position with numpy : 0.000270843505859375 nb_pixel_total : 18125 time to create 1 rle with old method : 0.019577741622924805 length of segment : 123 time for calcul the mask position with numpy : 0.0004642009735107422 nb_pixel_total : 21340 time to create 1 rle with old method : 0.0230712890625 length of segment : 225 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 3368 time to create 1 rle with old method : 0.0037484169006347656 length of segment : 65 time for calcul the mask position with numpy : 0.00018310546875 nb_pixel_total : 9244 time to create 1 rle with old method : 0.010297536849975586 length of segment : 150 time for calcul the mask position with numpy : 0.0004897117614746094 nb_pixel_total : 24385 time to create 1 rle with old method : 0.027080059051513672 length of segment : 227 time for calcul the mask position with numpy : 0.0005981922149658203 nb_pixel_total : 40437 time to create 1 rle with old method : 0.04341864585876465 length of segment : 315 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1957 time to create 1 rle with old method : 0.0022270679473876953 length of segment : 36 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 8064 time to create 1 rle with old method : 0.008919954299926758 length of segment : 99 time for calcul the mask position with numpy : 0.0004088878631591797 nb_pixel_total : 21058 time to create 1 rle with old method : 0.023728132247924805 length of segment : 130 time for calcul the mask position with numpy : 0.0002090930938720703 nb_pixel_total : 7619 time to create 1 rle with old method : 0.012614727020263672 length of segment : 105 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 2479 time to create 1 rle with old method : 0.004304647445678711 length of segment : 62 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 3526 time to create 1 rle with old method : 0.005837917327880859 length of segment : 100 time for calcul the mask position with numpy : 0.00017499923706054688 nb_pixel_total : 6667 time to create 1 rle with old method : 0.008383512496948242 length of segment : 88 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 3370 time to create 1 rle with old method : 0.0037736892700195312 length of segment : 103 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 4020 time to create 1 rle with old method : 0.004488706588745117 length of segment : 71 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 5856 time to create 1 rle with old method : 0.006448268890380859 length of segment : 180 time for calcul the mask position with numpy : 0.0015392303466796875 nb_pixel_total : 107502 time to create 1 rle with old method : 0.11003351211547852 length of segment : 521 time for calcul the mask position with numpy : 0.000247955322265625 nb_pixel_total : 11989 time to create 1 rle with old method : 0.013138771057128906 length of segment : 93 time for calcul the mask position with numpy : 0.0001456737518310547 nb_pixel_total : 6203 time to create 1 rle with old method : 0.0068547725677490234 length of segment : 117 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 18557 time to create 1 rle with old method : 0.020287752151489258 length of segment : 150 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 5001 time to create 1 rle with old method : 0.005692243576049805 length of segment : 76 time for calcul the mask position with numpy : 0.00031304359436035156 nb_pixel_total : 17515 time to create 1 rle with old method : 0.018758535385131836 length of segment : 144 time for calcul the mask position with numpy : 0.001596212387084961 nb_pixel_total : 118602 time to create 1 rle with old method : 0.13106203079223633 length of segment : 587 time for calcul the mask position with numpy : 0.00013566017150878906 nb_pixel_total : 5193 time to create 1 rle with old method : 0.006236076354980469 length of segment : 61 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 9434 time to create 1 rle with old method : 0.010624885559082031 length of segment : 171 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 3657 time to create 1 rle with old method : 0.004105567932128906 length of segment : 96 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 6682 time to create 1 rle with old method : 0.007673740386962891 length of segment : 110 time for calcul the mask position with numpy : 0.0002067089080810547 nb_pixel_total : 4599 time to create 1 rle with old method : 0.005345821380615234 length of segment : 176 time for calcul the mask position with numpy : 0.00012230873107910156 nb_pixel_total : 5413 time to create 1 rle with old method : 0.0061876773834228516 length of segment : 98 time for calcul the mask position with numpy : 0.0015811920166015625 nb_pixel_total : 101056 time to create 1 rle with old method : 0.10448956489562988 length of segment : 497 time for calcul the mask position with numpy : 0.00016188621520996094 nb_pixel_total : 5724 time to create 1 rle with old method : 0.0062503814697265625 length of segment : 142 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 3183 time to create 1 rle with old method : 0.0035390853881835938 length of segment : 70 time for calcul the mask position with numpy : 0.00021004676818847656 nb_pixel_total : 7873 time to create 1 rle with old method : 0.008437871932983398 length of segment : 99 time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 4635 time to create 1 rle with old method : 0.005117177963256836 length of segment : 56 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 10046 time to create 1 rle with old method : 0.01108860969543457 length of segment : 107 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 5932 time to create 1 rle with old method : 0.006762027740478516 length of segment : 112 time for calcul the mask position with numpy : 0.0003237724304199219 nb_pixel_total : 12166 time to create 1 rle with old method : 0.013414382934570312 length of segment : 163 time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 13069 time to create 1 rle with old method : 0.014774322509765625 length of segment : 150 time spent for convertir_results : 3.0593326091766357 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 61 chid ids of type : 3594 Number RLEs to save : 9949 save missing photos in datou_result : time spend for datou_step_exec : 31.451611042022705 time spend to save output : 1.2133457660675049 total time spend for step 1 : 32.66495680809021 step2:crop_condition Tue Sep 30 17:11:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 21 ! batch 1 Loaded 61 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3736932 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759245068_376531 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112272_0.png', 0, 71, 130, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112274_0.png', 0, 62, 97, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112273_0.png', 0, 68, 79, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112271_0.png', 0, 120, 202, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112276_0.png', 0, 107, 110, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962828_21e57ea4c69d3a6d860f9b4e0dc8375d_rle_crop_3981112278_0.png', 0, 149, 168, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962811_ab51c5ff7eb0f78e2adb4a57561cef5e_rle_crop_3981112281_0.png', 0, 60, 87, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962807_6a375132fd422f4956d469444af9d09d_rle_crop_3981112282_0.png', 0, 57, 104, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112285_0.png', 0, 141, 128, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112283_0.png', 0, 136, 197, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112286_0.png', 0, 69, 123, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112291_0.png', 0, 54, 113, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112289_0.png', 0, 155, 109, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112293_0.png', 0, 201, 121, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112292_0.png', 0, 190, 132, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112298_0.png', 0, 240, 232, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112296_0.png', 0, 94, 144, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112299_0.png', 0, 66, 36, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112295_0.png', 0, 69, 65, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112303_0.png', 0, 77, 60, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112306_0.png', 0, 42, 103, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112307_0.png', 0, 105, 56, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112308_0.png', 0, 64, 162, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962068_8b80ae7e6cb81008094b8434dc88de42_rle_crop_3981112313_0.png', 0, 132, 76, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112316_0.png', 0, 110, 57, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112320_0.png', 0, 117, 125, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112318_0.png', 0, 52, 96, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112317_0.png', 0, 108, 171, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112319_0.png', 0, 183, 109, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962051_88398a9934f0b9ec641d5a954316cf74_rle_crop_3981112321_0.png', 0, 77, 98, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962031_3bcec1dd77c5fc38318dbf6be0da1781_rle_crop_3981112324_0.png', 0, 83, 68, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962031_3bcec1dd77c5fc38318dbf6be0da1781_rle_crop_3981112323_0.png', 0, 72, 142, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112329_0.png', 0, 181, 163, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112326_0.png', 0, 111, 54, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112328_0.png', 0, 95, 106, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245074), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112325_0.png', 0, 122, 97, 0, 1759245074,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 36 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.791223764419556 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759245079_376531 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245080), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962828_21e57ea4c69d3a6d860f9b4e0dc8375d_rle_crop_3981112279_0.png', 0, 67, 149, 0, 1759245080,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245080), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112294_0.png', 0, 217, 191, 0, 1759245080,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245080), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962088_4baac5b0df9cb67524ba6816ceedc556_rle_crop_3981112304_0.png', 0, 55, 100, 0, 1759245080,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245080), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112314_0.png', 0, 175, 144, 0, 1759245080,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5502893924713135 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759245081_376531 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245082), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962088_4baac5b0df9cb67524ba6816ceedc556_rle_crop_3981112305_0.png', 0, 90, 88, 0, 1759245082,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8578693866729736 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759245086_376531 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112270_0.png', 0, 313, 193, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112275_0.png', 0, 205, 149, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112277_0.png', 0, 314, 526, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962811_ab51c5ff7eb0f78e2adb4a57561cef5e_rle_crop_3981112280_0.png', 0, 83, 112, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112284_0.png', 0, 241, 84, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112287_0.png', 0, 54, 72, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112288_0.png', 0, 318, 544, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112290_0.png', 0, 105, 179, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112297_0.png', 0, 198, 227, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112301_0.png', 0, 297, 122, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112300_0.png', 0, 107, 96, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112302_0.png', 0, 109, 105, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112310_0.png', 0, 181, 91, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112311_0.png', 0, 96, 113, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112309_0.png', 0, 325, 521, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962069_13b8cb53d42e2f3ac0c7eefd5f2480ab_rle_crop_3981112312_0.png', 0, 186, 142, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112315_0.png', 0, 317, 514, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386962051_88398a9934f0b9ec641d5a954316cf74_rle_crop_3981112322_0.png', 0, 332, 490, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112327_0.png', 0, 119, 107, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759245090), 0.0, 0.0, 14, '', 0, 0, '1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112330_0.png', 0, 255, 122, 0, 1759245090,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.348586559295654 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1386962905, 1386962902, 1386962828, 1386962816, 1386962811, 1386962807, 1386962796, 1386962770, 1386962098, 1386962096, 1386962094, 1386962088, 1386962084, 1386962081, 1386962072, 1386962069, 1386962068, 1386962065, 1386962051, 1386962031, 1386961527] Looping around the photos to save general results len do output : 61 /1386984839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1386984925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962905', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962902', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962828', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962816', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962811', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962807', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962796', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962770', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962098', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962096', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962094', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962088', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962084', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962081', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962072', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962069', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962068', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962065', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962051', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962031', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386961527', None, None, None, None, None, '3795031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 204 time used for this insertion : 0.04218435287475586 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.97972822189331 time spend to save output : 0.04471564292907715 total time spend for step 2 : 27.024443864822388 step3:rle_unique_nms_with_priority Tue Sep 30 17:11:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 61 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.20517325401306152 time for calcul the mask position with numpy : 0.13614559173583984 nb_pixel_total : 1997548 time to create 1 rle with new method : 0.15477848052978516 time for calcul the mask position with numpy : 0.0060694217681884766 nb_pixel_total : 4765 time to create 1 rle with old method : 0.005163669586181641 time for calcul the mask position with numpy : 0.0059125423431396484 nb_pixel_total : 4036 time to create 1 rle with old method : 0.004453897476196289 time for calcul the mask position with numpy : 0.00577998161315918 nb_pixel_total : 6626 time to create 1 rle with old method : 0.007273435592651367 time for calcul the mask position with numpy : 0.006099700927734375 nb_pixel_total : 15603 time to create 1 rle with old method : 0.016583681106567383 time for calcul the mask position with numpy : 0.0061795711517333984 nb_pixel_total : 45022 time to create 1 rle with old method : 0.048319339752197266 create new chi : 0.4132347106933594 time to delete rle : 0.1012868881225586 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 2734 TO DO : save crop sub photo not yet done ! save time : 0.4225773811340332 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06821107864379883 time for calcul the mask position with numpy : 0.019836902618408203 nb_pixel_total : 1940404 time to create 1 rle with new method : 0.09000205993652344 time for calcul the mask position with numpy : 0.00726628303527832 nb_pixel_total : 103193 time to create 1 rle with old method : 0.13951897621154785 time for calcul the mask position with numpy : 0.006346940994262695 nb_pixel_total : 7303 time to create 1 rle with old method : 0.008085966110229492 time for calcul the mask position with numpy : 0.006148576736450195 nb_pixel_total : 22700 time to create 1 rle with old method : 0.02483963966369629 create new chi : 0.3099548816680908 time to delete rle : 0.0004589557647705078 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2654 TO DO : save crop sub photo not yet done ! save time : 0.4111363887786865 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.040616512298583984 time for calcul the mask position with numpy : 0.022277116775512695 nb_pixel_total : 2056059 time to create 1 rle with new method : 0.17458343505859375 time for calcul the mask position with numpy : 0.006252765655517578 nb_pixel_total : 4855 time to create 1 rle with old method : 0.0052947998046875 time for calcul the mask position with numpy : 0.0065996646881103516 nb_pixel_total : 12686 time to create 1 rle with old method : 0.014114856719970703 create new chi : 0.2400670051574707 time to delete rle : 0.00029587745666503906 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 1802 TO DO : save crop sub photo not yet done ! save time : 0.32213664054870605 No data in photo_id : 1386962816 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04276442527770996 time for calcul the mask position with numpy : 0.1250627040863037 nb_pixel_total : 2062198 time to create 1 rle with new method : 0.171783447265625 time for calcul the mask position with numpy : 0.006452083587646484 nb_pixel_total : 4360 time to create 1 rle with old method : 0.004864931106567383 time for calcul the mask position with numpy : 0.006479501724243164 nb_pixel_total : 7042 time to create 1 rle with old method : 0.007813692092895508 create new chi : 0.3335895538330078 time to delete rle : 0.0002512931823730469 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1478 TO DO : save crop sub photo not yet done ! save time : 0.2770712375640869 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.035828351974487305 time for calcul the mask position with numpy : 0.021684885025024414 nb_pixel_total : 2070218 time to create 1 rle with new method : 0.18833065032958984 time for calcul the mask position with numpy : 0.006556510925292969 nb_pixel_total : 3382 time to create 1 rle with old method : 0.0038285255432128906 create new chi : 0.22814464569091797 time to delete rle : 0.0002951622009277344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1288 TO DO : save crop sub photo not yet done ! save time : 0.2703711986541748 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.2693667411804199 time for calcul the mask position with numpy : 0.0835416316986084 nb_pixel_total : 1907745 time to create 1 rle with new method : 0.1818559169769287 time for calcul the mask position with numpy : 0.007252216339111328 nb_pixel_total : 112334 time to create 1 rle with old method : 0.12668728828430176 time for calcul the mask position with numpy : 0.006215333938598633 nb_pixel_total : 3113 time to create 1 rle with old method : 0.003498554229736328 time for calcul the mask position with numpy : 0.009907722473144531 nb_pixel_total : 6482 time to create 1 rle with old method : 0.011007308959960938 time for calcul the mask position with numpy : 0.006634950637817383 nb_pixel_total : 13228 time to create 1 rle with old method : 0.015192031860351562 time for calcul the mask position with numpy : 0.006252288818359375 nb_pixel_total : 17062 time to create 1 rle with old method : 0.019248485565185547 time for calcul the mask position with numpy : 0.006277322769165039 nb_pixel_total : 13636 time to create 1 rle with old method : 0.015224456787109375 create new chi : 0.5105812549591064 time to delete rle : 0.0005500316619873047 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3496 TO DO : save crop sub photo not yet done ! save time : 0.5159392356872559 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.053009986877441406 time for calcul the mask position with numpy : 0.02082991600036621 nb_pixel_total : 2044941 time to create 1 rle with new method : 0.08466100692749023 time for calcul the mask position with numpy : 0.006029605865478516 nb_pixel_total : 3610 time to create 1 rle with old method : 0.003918886184692383 time for calcul the mask position with numpy : 0.006287336349487305 nb_pixel_total : 11448 time to create 1 rle with old method : 0.012950420379638672 time for calcul the mask position with numpy : 0.006476402282714844 nb_pixel_total : 13601 time to create 1 rle with old method : 0.015236139297485352 create new chi : 0.16377711296081543 time to delete rle : 0.0003952980041503906 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1936 TO DO : save crop sub photo not yet done ! save time : 0.3268296718597412 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04886054992675781 time for calcul the mask position with numpy : 0.019800662994384766 nb_pixel_total : 2020496 time to create 1 rle with new method : 0.16683030128479004 time for calcul the mask position with numpy : 0.006057262420654297 nb_pixel_total : 21340 time to create 1 rle with old method : 0.023444414138793945 time for calcul the mask position with numpy : 0.0060689449310302734 nb_pixel_total : 18125 time to create 1 rle with old method : 0.019713640213012695 time for calcul the mask position with numpy : 0.005858659744262695 nb_pixel_total : 13639 time to create 1 rle with old method : 0.015080690383911133 create new chi : 0.2704448699951172 time to delete rle : 0.0003428459167480469 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2096 TO DO : save crop sub photo not yet done ! save time : 0.37994956970214844 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.26860904693603516 time for calcul the mask position with numpy : 0.16224956512451172 nb_pixel_total : 1994209 time to create 1 rle with new method : 0.0866403579711914 time for calcul the mask position with numpy : 0.006405830383300781 nb_pixel_total : 1957 time to create 1 rle with old method : 0.002229452133178711 time for calcul the mask position with numpy : 0.006651401519775391 nb_pixel_total : 40437 time to create 1 rle with old method : 0.04653620719909668 time for calcul the mask position with numpy : 0.006331920623779297 nb_pixel_total : 24385 time to create 1 rle with old method : 0.02967691421508789 time for calcul the mask position with numpy : 0.006652355194091797 nb_pixel_total : 9244 time to create 1 rle with old method : 0.01039576530456543 time for calcul the mask position with numpy : 0.006177186965942383 nb_pixel_total : 3368 time to create 1 rle with old method : 0.003774404525756836 create new chi : 0.38501453399658203 time to delete rle : 0.0005152225494384766 batch 1 Loaded 11 chid ids of type : 3594 ++++++++++Number RLEs to save : 2666 TO DO : save crop sub photo not yet done ! save time : 0.43810105323791504 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.059175729751586914 time for calcul the mask position with numpy : 0.09636473655700684 nb_pixel_total : 2034380 time to create 1 rle with new method : 0.08341574668884277 time for calcul the mask position with numpy : 0.006242275238037109 nb_pixel_total : 2479 time to create 1 rle with old method : 0.0028166770935058594 time for calcul the mask position with numpy : 0.006383180618286133 nb_pixel_total : 7619 time to create 1 rle with old method : 0.008542776107788086 time for calcul the mask position with numpy : 0.0066394805908203125 nb_pixel_total : 21058 time to create 1 rle with old method : 0.023691654205322266 time for calcul the mask position with numpy : 0.0065174102783203125 nb_pixel_total : 8064 time to create 1 rle with old method : 0.009597301483154297 create new chi : 0.25888681411743164 time to delete rle : 0.00037217140197753906 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1872 TO DO : save crop sub photo not yet done ! save time : 0.3259556293487549 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04041337966918945 time for calcul the mask position with numpy : 0.020171642303466797 nb_pixel_total : 2063407 time to create 1 rle with new method : 0.3445110321044922 time for calcul the mask position with numpy : 0.007851123809814453 nb_pixel_total : 6667 time to create 1 rle with old method : 0.007504463195800781 time for calcul the mask position with numpy : 0.006783246994018555 nb_pixel_total : 3526 time to create 1 rle with old method : 0.003992319107055664 create new chi : 0.4028027057647705 time to delete rle : 0.0002884864807128906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1456 TO DO : save crop sub photo not yet done ! save time : 0.2952427864074707 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05491137504577637 time for calcul the mask position with numpy : 0.1263575553894043 nb_pixel_total : 2060354 time to create 1 rle with new method : 0.09636759757995605 time for calcul the mask position with numpy : 0.00701594352722168 nb_pixel_total : 5856 time to create 1 rle with old method : 0.006575822830200195 time for calcul the mask position with numpy : 0.006123781204223633 nb_pixel_total : 4020 time to create 1 rle with old method : 0.0045320987701416016 time for calcul the mask position with numpy : 0.006184577941894531 nb_pixel_total : 3370 time to create 1 rle with old method : 0.0037899017333984375 create new chi : 0.2689950466156006 time to delete rle : 0.0003266334533691406 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 1788 TO DO : save crop sub photo not yet done ! save time : 0.34139537811279297 No data in photo_id : 1386962081 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.060866594314575195 time for calcul the mask position with numpy : 0.15097451210021973 nb_pixel_total : 1947906 time to create 1 rle with new method : 0.2882812023162842 time for calcul the mask position with numpy : 0.006673097610473633 nb_pixel_total : 6203 time to create 1 rle with old method : 0.0071828365325927734 time for calcul the mask position with numpy : 0.006285667419433594 nb_pixel_total : 11989 time to create 1 rle with old method : 0.016853809356689453 time for calcul the mask position with numpy : 0.006787300109863281 nb_pixel_total : 107502 time to create 1 rle with old method : 0.12702226638793945 create new chi : 0.6225759983062744 time to delete rle : 0.00047516822814941406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2542 TO DO : save crop sub photo not yet done ! save time : 0.4706759452819824 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03521132469177246 time for calcul the mask position with numpy : 0.02273273468017578 nb_pixel_total : 2055043 time to create 1 rle with new method : 0.09821438789367676 time for calcul the mask position with numpy : 0.006971597671508789 nb_pixel_total : 18557 time to create 1 rle with old method : 0.020796537399291992 create new chi : 0.1567385196685791 time to delete rle : 0.00027298927307128906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1380 TO DO : save crop sub photo not yet done ! save time : 0.2759115695953369 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.041405677795410156 time for calcul the mask position with numpy : 0.026320934295654297 nb_pixel_total : 2068599 time to create 1 rle with new method : 0.18500375747680664 time for calcul the mask position with numpy : 0.006307125091552734 nb_pixel_total : 5001 time to create 1 rle with old method : 0.005655765533447266 create new chi : 0.23085713386535645 time to delete rle : 0.0002410411834716797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1232 TO DO : save crop sub photo not yet done ! save time : 0.2848196029663086 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.9745142459869385 time for calcul the mask position with numpy : 0.06491494178771973 nb_pixel_total : 1909522 time to create 1 rle with new method : 0.3618040084838867 time for calcul the mask position with numpy : 0.006623268127441406 nb_pixel_total : 2995 time to create 1 rle with old method : 0.0035810470581054688 time for calcul the mask position with numpy : 0.010766744613647461 nb_pixel_total : 6682 time to create 1 rle with old method : 0.007577180862426758 time for calcul the mask position with numpy : 0.010061502456665039 nb_pixel_total : 3657 time to create 1 rle with old method : 0.004304409027099609 time for calcul the mask position with numpy : 0.0062580108642578125 nb_pixel_total : 9434 time to create 1 rle with old method : 0.01046299934387207 time for calcul the mask position with numpy : 0.00617218017578125 nb_pixel_total : 5193 time to create 1 rle with old method : 0.005898237228393555 time for calcul the mask position with numpy : 0.007338523864746094 nb_pixel_total : 118602 time to create 1 rle with old method : 0.1454322338104248 time for calcul the mask position with numpy : 0.007075786590576172 nb_pixel_total : 17515 time to create 1 rle with old method : 0.02107548713684082 create new chi : 0.6904242038726807 time to delete rle : 0.0007452964782714844 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++Number RLEs to save : 3666 TO DO : save crop sub photo not yet done ! save time : 0.605771541595459 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.07509589195251465 time for calcul the mask position with numpy : 0.020602703094482422 nb_pixel_total : 1967131 time to create 1 rle with new method : 0.0420987606048584 time for calcul the mask position with numpy : 0.006970643997192383 nb_pixel_total : 101056 time to create 1 rle with old method : 0.11759352684020996 time for calcul the mask position with numpy : 0.00671076774597168 nb_pixel_total : 5413 time to create 1 rle with old method : 0.006119251251220703 create new chi : 0.2005467414855957 time to delete rle : 0.00038886070251464844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2270 TO DO : save crop sub photo not yet done ! save time : 0.37886977195739746 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04232501983642578 time for calcul the mask position with numpy : 0.02179861068725586 nb_pixel_total : 2064693 time to create 1 rle with new method : 0.030169248580932617 time for calcul the mask position with numpy : 0.0068471431732177734 nb_pixel_total : 3183 time to create 1 rle with old method : 0.003601551055908203 time for calcul the mask position with numpy : 0.006600856781005859 nb_pixel_total : 5724 time to create 1 rle with old method : 0.006535053253173828 create new chi : 0.07583189010620117 time to delete rle : 0.0002846717834472656 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1504 TO DO : save crop sub photo not yet done ! save time : 0.3211214542388916 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.47814083099365234 time for calcul the mask position with numpy : 0.29219579696655273 nb_pixel_total : 2020234 time to create 1 rle with new method : 0.25319766998291016 time for calcul the mask position with numpy : 0.00740361213684082 nb_pixel_total : 12714 time to create 1 rle with old method : 0.015374898910522461 time for calcul the mask position with numpy : 0.006638765335083008 nb_pixel_total : 12166 time to create 1 rle with old method : 0.01584005355834961 time for calcul the mask position with numpy : 0.006356477737426758 nb_pixel_total : 5932 time to create 1 rle with old method : 0.006699323654174805 time for calcul the mask position with numpy : 0.006448268890380859 nb_pixel_total : 10046 time to create 1 rle with old method : 0.011599063873291016 time for calcul the mask position with numpy : 0.006292104721069336 nb_pixel_total : 4635 time to create 1 rle with old method : 0.0052716732025146484 time for calcul the mask position with numpy : 0.0064928531646728516 nb_pixel_total : 7873 time to create 1 rle with old method : 0.009161949157714844 create new chi : 0.6606178283691406 time to delete rle : 0.0007202625274658203 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 2417 TO DO : save crop sub photo not yet done ! save time : 0.4322996139526367 map_output_result : {1386962905: (0.0, 'Should be the crop_list due to order', 0), 1386962902: (0.0, 'Should be the crop_list due to order', 0), 1386962828: (0.0, 'Should be the crop_list due to order', 0), 1386962816: (0.0, 'Should be the crop_list due to order', 0.0), 1386962811: (0.0, 'Should be the crop_list due to order', 0), 1386962807: (0.0, 'Should be the crop_list due to order', 0), 1386962796: (0.0, 'Should be the crop_list due to order', 0), 1386962770: (0.0, 'Should be the crop_list due to order', 0), 1386962098: (0.0, 'Should be the crop_list due to order', 0), 1386962096: (0.0, 'Should be the crop_list due to order', 0), 1386962094: (0.0, 'Should be the crop_list due to order', 0), 1386962088: (0.0, 'Should be the crop_list due to order', 0), 1386962084: (0.0, 'Should be the crop_list due to order', 0), 1386962081: (0.0, 'Should be the crop_list due to order', 0.0), 1386962072: (0.0, 'Should be the crop_list due to order', 0), 1386962069: (0.0, 'Should be the crop_list due to order', 0), 1386962068: (0.0, 'Should be the crop_list due to order', 0), 1386962065: (0.0, 'Should be the crop_list due to order', 0), 1386962051: (0.0, 'Should be the crop_list due to order', 0), 1386962031: (0.0, 'Should be the crop_list due to order', 0), 1386961527: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1386962905, 1386962902, 1386962828, 1386962816, 1386962811, 1386962807, 1386962796, 1386962770, 1386962098, 1386962096, 1386962094, 1386962088, 1386962084, 1386962081, 1386962072, 1386962069, 1386962068, 1386962065, 1386962051, 1386962031, 1386961527] Looping around the photos to save general results len do output : 21 /1386962905.Didn't retrieve data . /1386962902.Didn't retrieve data . /1386962828.Didn't retrieve data . /1386962816.Didn't retrieve data . /1386962811.Didn't retrieve data . /1386962807.Didn't retrieve data . /1386962796.Didn't retrieve data . /1386962770.Didn't retrieve data . /1386962098.Didn't retrieve data . /1386962096.Didn't retrieve data . /1386962094.Didn't retrieve data . /1386962088.Didn't retrieve data . /1386962084.Didn't retrieve data . /1386962081.Didn't retrieve data . /1386962072.Didn't retrieve data . /1386962069.Didn't retrieve data . /1386962068.Didn't retrieve data . /1386962065.Didn't retrieve data . /1386962051.Didn't retrieve data . /1386962031.Didn't retrieve data . /1386961527.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962905', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962902', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962828', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962816', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962811', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962807', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962796', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962770', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962098', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962096', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962094', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962088', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962084', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962081', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962072', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962069', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962068', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962065', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962051', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962031', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386961527', None, None, None, None, None, '3795031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 63 time used for this insertion : 0.03719592094421387 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.246206283569336 time spend to save output : 0.03796076774597168 total time spend for step 3 : 17.284167051315308 step4:ventilate_hashtags_in_portfolio Tue Sep 30 17:11:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27355643 get user id for portfolio 27355643 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27355643 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','flou','environnement','papier','metal','background','carton','mal_croppe','pehd','pet_fonce','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27355643 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','flou','environnement','papier','metal','background','carton','mal_croppe','pehd','pet_fonce','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27355643 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','flou','environnement','papier','metal','background','carton','mal_croppe','pehd','pet_fonce','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27357405,27357406,27357407,27357408,27357409,27357410,27357411,27357412,27357413,27357414,27357415?tags=pet_clair,flou,environnement,papier,metal,background,carton,mal_croppe,pehd,pet_fonce,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1386962905, 1386962902, 1386962828, 1386962816, 1386962811, 1386962807, 1386962796, 1386962770, 1386962098, 1386962096, 1386962094, 1386962088, 1386962084, 1386962081, 1386962072, 1386962069, 1386962068, 1386962065, 1386962051, 1386962031, 1386961527] Looping around the photos to save general results len do output : 1 /27355643. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962905', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962902', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962828', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962816', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962811', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962807', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962796', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962770', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962098', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962096', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962094', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962088', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962084', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962081', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962072', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962069', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962068', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962065', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962051', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962031', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386961527', None, None, None, None, None, '3795031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 22 time used for this insertion : 0.03696322441101074 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.489911079406738 time spend to save output : 0.037616729736328125 total time spend for step 4 : 5.527527809143066 step5:final Tue Sep 30 17:11:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1386962905: ('0.025566601447677834',), 1386962902: ('0.025566601447677834',), 1386962828: ('0.025566601447677834',), 1386962816: ('0.025566601447677834',), 1386962811: ('0.025566601447677834',), 1386962807: ('0.025566601447677834',), 1386962796: ('0.025566601447677834',), 1386962770: ('0.025566601447677834',), 1386962098: ('0.025566601447677834',), 1386962096: ('0.025566601447677834',), 1386962094: ('0.025566601447677834',), 1386962088: ('0.025566601447677834',), 1386962084: ('0.025566601447677834',), 1386962081: ('0.025566601447677834',), 1386962072: ('0.025566601447677834',), 1386962069: ('0.025566601447677834',), 1386962068: ('0.025566601447677834',), 1386962065: ('0.025566601447677834',), 1386962051: ('0.025566601447677834',), 1386962031: ('0.025566601447677834',), 1386961527: ('0.025566601447677834',)} new output for save of step final : {1386962905: ('0.025566601447677834',), 1386962902: ('0.025566601447677834',), 1386962828: ('0.025566601447677834',), 1386962816: ('0.025566601447677834',), 1386962811: ('0.025566601447677834',), 1386962807: ('0.025566601447677834',), 1386962796: ('0.025566601447677834',), 1386962770: ('0.025566601447677834',), 1386962098: ('0.025566601447677834',), 1386962096: ('0.025566601447677834',), 1386962094: ('0.025566601447677834',), 1386962088: ('0.025566601447677834',), 1386962084: ('0.025566601447677834',), 1386962081: ('0.025566601447677834',), 1386962072: ('0.025566601447677834',), 1386962069: ('0.025566601447677834',), 1386962068: ('0.025566601447677834',), 1386962065: ('0.025566601447677834',), 1386962051: ('0.025566601447677834',), 1386962031: ('0.025566601447677834',), 1386961527: ('0.025566601447677834',)} [1386962905, 1386962902, 1386962828, 1386962816, 1386962811, 1386962807, 1386962796, 1386962770, 1386962098, 1386962096, 1386962094, 1386962088, 1386962084, 1386962081, 1386962072, 1386962069, 1386962068, 1386962065, 1386962051, 1386962031, 1386961527] Looping around the photos to save general results len do output : 21 /1386962905.Didn't retrieve data . /1386962902.Didn't retrieve data . /1386962828.Didn't retrieve data . /1386962816.Didn't retrieve data . /1386962811.Didn't retrieve data . /1386962807.Didn't retrieve data . /1386962796.Didn't retrieve data . /1386962770.Didn't retrieve data . /1386962098.Didn't retrieve data . /1386962096.Didn't retrieve data . /1386962094.Didn't retrieve data . /1386962088.Didn't retrieve data . /1386962084.Didn't retrieve data . /1386962081.Didn't retrieve data . /1386962072.Didn't retrieve data . /1386962069.Didn't retrieve data . /1386962068.Didn't retrieve data . /1386962065.Didn't retrieve data . /1386962051.Didn't retrieve data . /1386962031.Didn't retrieve data . /1386961527.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962905', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962902', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962828', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962816', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962811', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962807', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962796', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962770', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962098', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962096', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962094', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962088', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962084', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962081', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962072', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962069', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962068', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962065', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962051', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962031', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386961527', None, None, None, None, None, '3795031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 63 time used for this insertion : 0.03838825225830078 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3826756477355957 time spend to save output : 0.03942751884460449 total time spend for step 5 : 0.4221031665802002 step6:blur_detection Tue Sep 30 17:11:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc.jpg resize: (1080, 1920) 1386962905 2.553710868582715 treat image : temp/1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f.jpg resize: (1080, 1920) 1386962902 -3.1325410947444525 treat image : temp/1759245029_376531_1386962828_21e57ea4c69d3a6d860f9b4e0dc8375d.jpg resize: (1080, 1920) 1386962828 0.8825666277591369 treat image : temp/1759245029_376531_1386962816_62ea0c8de8c72e278044ec72aa3a435b.jpg resize: (1080, 1920) 1386962816 0.36577039939946226 treat image : temp/1759245029_376531_1386962811_ab51c5ff7eb0f78e2adb4a57561cef5e.jpg resize: (1080, 1920) 1386962811 -0.24808388695101716 treat image : temp/1759245029_376531_1386962807_6a375132fd422f4956d469444af9d09d.jpg resize: (1080, 1920) 1386962807 0.5646997974649549 treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03.jpg resize: (1080, 1920) 1386962796 1.4612936434197288 treat image : temp/1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b.jpg resize: (1080, 1920) 1386962770 -0.004874471286446512 treat image : temp/1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711.jpg resize: (1080, 1920) 1386962098 1.1365104559142822 treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4.jpg resize: (1080, 1920) 1386962096 -0.3354684406922173 treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d.jpg resize: (1080, 1920) 1386962094 1.1767497716722253 treat image : temp/1759245029_376531_1386962088_4baac5b0df9cb67524ba6816ceedc556.jpg resize: (1080, 1920) 1386962088 1.1115996578930671 treat image : temp/1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6.jpg resize: (1080, 1920) 1386962084 0.9946743673994467 treat image : temp/1759245029_376531_1386962081_e2ab0f984b3a9c7c301afba6d8e23718.jpg resize: (1080, 1920) 1386962081 0.16960049829161922 treat image : temp/1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38.jpg resize: (1080, 1920) 1386962072 1.475126686454943 treat image : temp/1759245029_376531_1386962069_13b8cb53d42e2f3ac0c7eefd5f2480ab.jpg resize: (1080, 1920) 1386962069 0.3516106215660958 treat image : temp/1759245029_376531_1386962068_8b80ae7e6cb81008094b8434dc88de42.jpg resize: (1080, 1920) 1386962068 0.508957726654661 treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70.jpg resize: (1080, 1920) 1386962065 0.17152473111379374 treat image : temp/1759245029_376531_1386962051_88398a9934f0b9ec641d5a954316cf74.jpg resize: (1080, 1920) 1386962051 2.742182204354386 treat image : temp/1759245029_376531_1386962031_3bcec1dd77c5fc38318dbf6be0da1781.jpg resize: (1080, 1920) 1386962031 0.0342025964162372 treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd.jpg resize: (1080, 1920) 1386961527 -2.7850117770887794 treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112272_0.png resize: (130, 71) 1386984839 -0.5234647429129146 treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112274_0.png resize: (97, 62) 1386984840 2.75701494590538 treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112273_0.png resize: (79, 68) 1386984841 0.1091400911705763 treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112271_0.png resize: (202, 120) 1386984842 -1.2670470550245414 treat image : temp/1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112276_0.png resize: (110, 107) 1386984843 -4.334904769756692 treat image : temp/1759245029_376531_1386962828_21e57ea4c69d3a6d860f9b4e0dc8375d_rle_crop_3981112278_0.png resize: (168, 149) 1386984844 0.5403039536494743 treat image : temp/1759245029_376531_1386962811_ab51c5ff7eb0f78e2adb4a57561cef5e_rle_crop_3981112281_0.png resize: (87, 60) 1386984845 2.451747892136897 treat image : temp/1759245029_376531_1386962807_6a375132fd422f4956d469444af9d09d_rle_crop_3981112282_0.png resize: (104, 57) 1386984846 -2.0017930410647815 treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112285_0.png resize: (128, 141) 1386984847 -0.4769794281725077 treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112283_0.png resize: (197, 136) 1386984848 1.6574565186189876 treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112286_0.png resize: (123, 69) 1386984849 -0.08078410157967636 treat image : temp/1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112291_0.png resize: (113, 54) 1386984850 -2.12320439389472 treat image : temp/1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112289_0.png resize: (109, 155) 1386984851 -0.09632826955358562 treat image : temp/1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112293_0.png resize: (121, 201) 1386984852 0.4744262264976994 treat image : temp/1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112292_0.png resize: (132, 190) 1386984853 -2.6585172644795807 treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112298_0.png resize: (232, 240) 1386984854 -1.2683326763951714 treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112296_0.png resize: (144, 94) 1386984855 -0.9162812673602041 treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112299_0.png resize: (36, 66) 1386984857 -1.0745967747572471 treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112295_0.png resize: (65, 69) 1386984858 0.7257533631450729 treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112303_0.png resize: (60, 77) 1386984859 -1.7744152913584808 treat image : temp/1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112306_0.png resize: (103, 42) 1386984860 3.00058096518581 treat image : temp/1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112307_0.png resize: (56, 105) 1386984861 0.5621182898355704 treat image : temp/1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112308_0.png resize: (162, 64) 1386984862 -2.045654616391438 treat image : temp/1759245029_376531_1386962068_8b80ae7e6cb81008094b8434dc88de42_rle_crop_3981112313_0.png resize: (76, 132) 1386984863 -1.9862030943704487 treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112316_0.png resize: (57, 110) 1386984864 2.2835462785274356 treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112320_0.png resize: (125, 117) 1386984865 -2.3338534751075604 treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112318_0.png resize: (96, 52) 1386984867 0.10161509914002315 treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112317_0.png resize: (171, 108) 1386984868 -1.7982885010432024 treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112319_0.png resize: (109, 183) 1386984869 -2.450113303692226 treat image : temp/1759245029_376531_1386962051_88398a9934f0b9ec641d5a954316cf74_rle_crop_3981112321_0.png resize: (98, 77) 1386984870 3.700812099221316 treat image : temp/1759245029_376531_1386962031_3bcec1dd77c5fc38318dbf6be0da1781_rle_crop_3981112324_0.png resize: (68, 83) 1386984871 -1.2447916117601616 treat image : temp/1759245029_376531_1386962031_3bcec1dd77c5fc38318dbf6be0da1781_rle_crop_3981112323_0.png resize: (142, 72) 1386984872 -2.37221636550807 treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112329_0.png resize: (163, 181) 1386984873 -2.01818306529688 treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112326_0.png resize: (54, 111) 1386984874 -2.0570899280498307 treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112328_0.png resize: (106, 95) 1386984875 -2.4765003790658757 treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112325_0.png resize: (97, 122) 1386984876 -0.8090929433072857 treat image : temp/1759245029_376531_1386962828_21e57ea4c69d3a6d860f9b4e0dc8375d_rle_crop_3981112279_0.png resize: (149, 67) 1386984878 -2.340994957879944 treat image : temp/1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112294_0.png resize: (191, 217) 1386984880 -2.049516359407205 treat image : temp/1759245029_376531_1386962088_4baac5b0df9cb67524ba6816ceedc556_rle_crop_3981112304_0.png resize: (100, 55) 1386984881 -1.6149794340049963 treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112314_0.png resize: (144, 175) 1386984882 -1.3328875749309146 treat image : temp/1759245029_376531_1386962088_4baac5b0df9cb67524ba6816ceedc556_rle_crop_3981112305_0.png resize: (88, 90) 1386984884 0.5143955057115801 treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112270_0.png resize: (193, 313) 1386984901 -1.8086440929129557 treat image : temp/1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112275_0.png resize: (149, 205) 1386984902 -2.1800001986850344 treat image : temp/1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112277_0.png resize: (526, 314) 1386984903 0.09975127138366717 treat image : temp/1759245029_376531_1386962811_ab51c5ff7eb0f78e2adb4a57561cef5e_rle_crop_3981112280_0.png resize: (112, 83) 1386984904 -2.0665922684158007 treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112284_0.png resize: (84, 241) 1386984905 1.004564234708593 treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112287_0.png resize: (72, 54) 1386984906 -0.7389174281707872 treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112288_0.png resize: (544, 318) 1386984907 0.35535986560608424 treat image : temp/1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112290_0.png resize: (179, 105) 1386984909 -2.037646797949077 treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112297_0.png resize: (227, 198) 1386984910 -0.9067655987597447 treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112301_0.png resize: (122, 297) 1386984911 0.3355344695590117 treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112300_0.png resize: (96, 107) 1386984912 -0.4970170907131954 treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112302_0.png resize: (105, 109) 1386984913 -1.6447537513563355 treat image : temp/1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112310_0.png resize: (91, 181) 1386984916 -0.016610558997394928 treat image : temp/1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112311_0.png resize: (113, 96) 1386984918 -1.3808190036056573 treat image : temp/1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112309_0.png resize: (521, 325) 1386984920 0.20744861580147259 treat image : temp/1759245029_376531_1386962069_13b8cb53d42e2f3ac0c7eefd5f2480ab_rle_crop_3981112312_0.png resize: (142, 186) 1386984921 -1.3320553085014248 treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112315_0.png resize: (514, 317) 1386984922 -0.8306715946760264 treat image : temp/1759245029_376531_1386962051_88398a9934f0b9ec641d5a954316cf74_rle_crop_3981112322_0.png resize: (490, 332) 1386984923 -0.16286231619286554 treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112327_0.png resize: (107, 119) 1386984924 -3.977509741906245 treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112330_0.png resize: (122, 255) 1386984925 -2.7944944054008687 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 82 time used for this insertion : 0.03740262985229492 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 82 time used for this insertion : 0.03832674026489258 save missing photos in datou_result : time spend for datou_step_exec : 17.341036081314087 time spend to save output : 0.09380817413330078 total time spend for step 6 : 17.434844255447388 step7:brightness Tue Sep 30 17:12:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc.jpg treat image : temp/1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f.jpg treat image : temp/1759245029_376531_1386962828_21e57ea4c69d3a6d860f9b4e0dc8375d.jpg treat image : temp/1759245029_376531_1386962816_62ea0c8de8c72e278044ec72aa3a435b.jpg treat image : temp/1759245029_376531_1386962811_ab51c5ff7eb0f78e2adb4a57561cef5e.jpg treat image : temp/1759245029_376531_1386962807_6a375132fd422f4956d469444af9d09d.jpg treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03.jpg treat image : temp/1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b.jpg treat image : temp/1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711.jpg treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4.jpg treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d.jpg treat image : temp/1759245029_376531_1386962088_4baac5b0df9cb67524ba6816ceedc556.jpg treat image : temp/1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6.jpg treat image : temp/1759245029_376531_1386962081_e2ab0f984b3a9c7c301afba6d8e23718.jpg treat image : temp/1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38.jpg treat image : temp/1759245029_376531_1386962069_13b8cb53d42e2f3ac0c7eefd5f2480ab.jpg treat image : temp/1759245029_376531_1386962068_8b80ae7e6cb81008094b8434dc88de42.jpg treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70.jpg treat image : temp/1759245029_376531_1386962051_88398a9934f0b9ec641d5a954316cf74.jpg treat image : temp/1759245029_376531_1386962031_3bcec1dd77c5fc38318dbf6be0da1781.jpg treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd.jpg treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112272_0.png treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112274_0.png treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112273_0.png treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112271_0.png treat image : temp/1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112276_0.png treat image : temp/1759245029_376531_1386962828_21e57ea4c69d3a6d860f9b4e0dc8375d_rle_crop_3981112278_0.png treat image : temp/1759245029_376531_1386962811_ab51c5ff7eb0f78e2adb4a57561cef5e_rle_crop_3981112281_0.png treat image : temp/1759245029_376531_1386962807_6a375132fd422f4956d469444af9d09d_rle_crop_3981112282_0.png treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112285_0.png treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112283_0.png treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112286_0.png treat image : temp/1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112291_0.png treat image : temp/1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112289_0.png treat image : temp/1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112293_0.png treat image : temp/1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112292_0.png treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112298_0.png treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112296_0.png treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112299_0.png treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112295_0.png treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112303_0.png treat image : temp/1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112306_0.png treat image : temp/1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112307_0.png treat image : temp/1759245029_376531_1386962084_bf0ce4955869d16f8dec2c2c6e5890d6_rle_crop_3981112308_0.png treat image : temp/1759245029_376531_1386962068_8b80ae7e6cb81008094b8434dc88de42_rle_crop_3981112313_0.png treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112316_0.png treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112320_0.png treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112318_0.png treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112317_0.png treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112319_0.png treat image : temp/1759245029_376531_1386962051_88398a9934f0b9ec641d5a954316cf74_rle_crop_3981112321_0.png treat image : temp/1759245029_376531_1386962031_3bcec1dd77c5fc38318dbf6be0da1781_rle_crop_3981112324_0.png treat image : temp/1759245029_376531_1386962031_3bcec1dd77c5fc38318dbf6be0da1781_rle_crop_3981112323_0.png treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112329_0.png treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112326_0.png treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112328_0.png treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112325_0.png treat image : temp/1759245029_376531_1386962828_21e57ea4c69d3a6d860f9b4e0dc8375d_rle_crop_3981112279_0.png treat image : temp/1759245029_376531_1386962098_2c80c81c0b0bd3fa1e824669efa3a711_rle_crop_3981112294_0.png treat image : temp/1759245029_376531_1386962088_4baac5b0df9cb67524ba6816ceedc556_rle_crop_3981112304_0.png treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112314_0.png treat image : temp/1759245029_376531_1386962088_4baac5b0df9cb67524ba6816ceedc556_rle_crop_3981112305_0.png treat image : temp/1759245029_376531_1386962905_e0ffe47eaa12db3854db7e593100e7fc_rle_crop_3981112270_0.png treat image : temp/1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112275_0.png treat image : temp/1759245029_376531_1386962902_3b505279ee462c8c92ed14285ab14b4f_rle_crop_3981112277_0.png treat image : temp/1759245029_376531_1386962811_ab51c5ff7eb0f78e2adb4a57561cef5e_rle_crop_3981112280_0.png treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112284_0.png treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112287_0.png treat image : temp/1759245029_376531_1386962796_3bd59db5d2d9f7820af64631144eaf03_rle_crop_3981112288_0.png treat image : temp/1759245029_376531_1386962770_5c955687c5fd26f76180060e11771a3b_rle_crop_3981112290_0.png treat image : temp/1759245029_376531_1386962096_e6bacbf535425ada26a3847397de2cc4_rle_crop_3981112297_0.png treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112301_0.png treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112300_0.png treat image : temp/1759245029_376531_1386962094_0609c26afdc4cd29c8dbdba51281e43d_rle_crop_3981112302_0.png treat image : temp/1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112310_0.png treat image : temp/1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112311_0.png treat image : temp/1759245029_376531_1386962072_25f940cca869bc1dc2237badcdeb5c38_rle_crop_3981112309_0.png treat image : temp/1759245029_376531_1386962069_13b8cb53d42e2f3ac0c7eefd5f2480ab_rle_crop_3981112312_0.png treat image : temp/1759245029_376531_1386962065_fe2cb1d6010175b69b6cc4aaadb47d70_rle_crop_3981112315_0.png treat image : temp/1759245029_376531_1386962051_88398a9934f0b9ec641d5a954316cf74_rle_crop_3981112322_0.png treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112327_0.png treat image : temp/1759245029_376531_1386961527_3937d15b9df2590d899efd970c2ec7bd_rle_crop_3981112330_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 82 time used for this insertion : 0.038260459899902344 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 82 time used for this insertion : 0.037764549255371094 save missing photos in datou_result : time spend for datou_step_exec : 4.947762489318848 time spend to save output : 0.0942831039428711 total time spend for step 7 : 5.042045593261719 step8:velours_tree Tue Sep 30 17:12:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15689373016357422 time spend to save output : 5.340576171875e-05 total time spend for step 8 : 0.15694713592529297 step9:send_mail_cod Tue Sep 30 17:12:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27355643_30-09-2025_17_12_18.pdf 27357405 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette273574051759245138 27357406 imagette273574061759245140 27357408 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette273574081759245140 27357409 change filename to text .imagette273574091759245141 27357410 imagette273574101759245141 27357411 change filename to text .change filename to text .change filename to text .change filename to text .imagette273574111759245141 27357412 imagette273574121759245142 27357413 imagette273574131759245142 27357414 imagette273574141759245142 27357415 imagette273574151759245142 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27355643 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27357405,27357406,27357407,27357408,27357409,27357410,27357411,27357412,27357413,27357414,27357415?tags=pet_clair,flou,environnement,papier,metal,background,carton,mal_croppe,pehd,pet_fonce,autre args[1386962905] : ((1386962905, 2.553710868582715, 492688767), (1386962905, 0.5383509120075688, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962902] : ((1386962902, -3.1325410947444525, 492609224), (1386962902, 0.3884745233278322, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962828] : ((1386962828, 0.8825666277591369, 492688767), (1386962828, 0.7236629975973479, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962816] : ((1386962816, 0.36577039939946226, 492688767), (1386962816, 0.5884590052204586, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962811] : ((1386962811, -0.24808388695101716, 492688767), (1386962811, 0.7599985291861386, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962807] : ((1386962807, 0.5646997974649549, 492688767), (1386962807, 0.5463405309230348, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962796] : ((1386962796, 1.4612936434197288, 492688767), (1386962796, 0.6327047148514553, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962770] : ((1386962770, -0.004874471286446512, 492688767), (1386962770, 0.6909750560216912, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962098] : ((1386962098, 1.1365104559142822, 492688767), (1386962098, 0.4087592547491814, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962096] : ((1386962096, -0.3354684406922173, 492688767), (1386962096, 0.3878871249895508, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962094] : ((1386962094, 1.1767497716722253, 492688767), (1386962094, 0.39181829281404323, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962088] : ((1386962088, 1.1115996578930671, 492688767), (1386962088, 0.6563206409187485, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962084] : ((1386962084, 0.9946743673994467, 492688767), (1386962084, 0.7350885948693267, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962081] : ((1386962081, 0.16960049829161922, 492688767), (1386962081, 0.6891962914850278, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962072] : ((1386962072, 1.475126686454943, 492688767), (1386962072, 0.3785536953112074, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962069] : ((1386962069, 0.3516106215660958, 492688767), (1386962069, 0.44276335054886573, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962068] : ((1386962068, 0.508957726654661, 492688767), (1386962068, 0.4792398262649572, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962065] : ((1386962065, 0.17152473111379374, 492688767), (1386962065, 0.5455628026698895, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962051] : ((1386962051, 2.742182204354386, 492688767), (1386962051, 0.8875716154769729, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386962031] : ((1386962031, 0.0342025964162372, 492688767), (1386962031, 0.6146050180215107, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com args[1386961527] : ((1386961527, -2.7850117770887794, 492609224), (1386961527, 0.4303110677808425, 2107752395), '0.025566601447677834') We are sending mail with results at report@fotonower.com refus_total : 0.025566601447677834 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27355643 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27355643_30-09-2025_17_12_18.pdf results_Auto_P27355643_30-09-2025_17_12_18.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27355643_30-09-2025_17_12_18.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27355643','results_Auto_P27355643_30-09-2025_17_12_18.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27355643_30-09-2025_17_12_18.pdf','pdf','','0.29','0.025566601447677834') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27355643

https://www.fotonower.com/image?json=false&list_photos_id=1386962905
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.553710868582715)
https://www.fotonower.com/image?json=false&list_photos_id=1386962902
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962828
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962816
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962811
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962807
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962796
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4612936434197288)
https://www.fotonower.com/image?json=false&list_photos_id=1386962770
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962098
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1365104559142822)
https://www.fotonower.com/image?json=false&list_photos_id=1386962096
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962094
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1767497716722253)
https://www.fotonower.com/image?json=false&list_photos_id=1386962088
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1115996578930671)
https://www.fotonower.com/image?json=false&list_photos_id=1386962084
La photo est trop floue, merci de reprendre une photo.(avec le score = 0.9946743673994467)
https://www.fotonower.com/image?json=false&list_photos_id=1386962081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962072
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.475126686454943)
https://www.fotonower.com/image?json=false&list_photos_id=1386962069
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962068
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962065
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386962051
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.742182204354386)
https://www.fotonower.com/image?json=false&list_photos_id=1386962031
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386961527
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 2.56%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/27357405?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27357408?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27357409?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27357411?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27355643_30-09-2025_17_12_18.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27357405,27357406,27357407,27357408,27357409,27357410,27357411,27357412,27357413,27357414,27357415?tags=pet_clair,flou,environnement,papier,metal,background,carton,mal_croppe,pehd,pet_fonce,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 30 Sep 2025 15:12:24 GMT Content-Length: 0 Connection: close X-Message-Id: a1Gb2AAqTb-QyeUZGHKC-g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1386962905, 1386962902, 1386962828, 1386962816, 1386962811, 1386962807, 1386962796, 1386962770, 1386962098, 1386962096, 1386962094, 1386962088, 1386962084, 1386962081, 1386962072, 1386962069, 1386962068, 1386962065, 1386962051, 1386962031, 1386961527] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962905', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962902', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962828', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962816', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962811', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962807', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962796', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962770', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962098', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962096', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962094', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962088', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962084', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962081', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962072', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962069', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962068', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962065', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962051', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962031', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386961527', None, None, None, None, None, '3795031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.03821420669555664 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.324421644210815 time spend to save output : 0.03864431381225586 total time spend for step 9 : 6.363065958023071 step10:split_time_score Tue Sep 30 17:12:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 21),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 30092025 27355643 Nombre de photos uploadées : 21 / 23040 (0%) 30092025 27355643 Nombre de photos taguées (types de déchets): 0 / 21 (0%) 30092025 27355643 Nombre de photos taguées (volume) : 0 / 21 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 9.059906005859375e-06 ????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001033782958984375 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6501555442810059 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.25469097222222226 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27344240_30-09-2025_17_08_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344240 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27344240 AND mptpi.`type`=3594 To do Qualite : 0.1986372843013468 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27344242_30-09-2025_17_08_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344242 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27344242 AND mptpi.`type`=3594 To do Qualite : 0.040582133058984914 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27344246_30-09-2025_17_08_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344246 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27344246 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27355641 order by id desc limit 1 Qualite : 0.025566601447677834 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27355643_30-09-2025_17_12_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27355643 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27355643 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'30092025': {'nb_upload': 21, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1386962905, 1386962902, 1386962828, 1386962816, 1386962811, 1386962807, 1386962796, 1386962770, 1386962098, 1386962096, 1386962094, 1386962088, 1386962084, 1386962081, 1386962072, 1386962069, 1386962068, 1386962065, 1386962051, 1386962031, 1386961527] Looping around the photos to save general results len do output : 1 /27355643Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962905', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962902', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962828', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962816', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962811', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962807', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962796', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962770', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962098', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962096', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962094', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962088', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962084', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962081', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962072', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962069', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962068', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962065', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962051', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386962031', None, None, None, None, None, '3795031') ('3318', None, None, None, None, None, None, None, '3795031') ('3318', '27355643', '1386961527', None, None, None, None, None, '3795031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 22 time used for this insertion : 0.04179048538208008 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.9142844676971436 time spend to save output : 0.0421748161315918 total time spend for step 10 : 3.9564592838287354 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 21 set_done_treatment 54.78user 28.73system 2:03.11elapsed 67%CPU (0avgtext+0avgdata 3207240maxresident)k 25392inputs+19872outputs (365major+2113738minor)pagefaults 0swaps