python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2048797 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4348464'] with mtr_portfolio_ids : ['30454598'] and first list_photo_ids : [] new path : /proc/2048797/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 19 ; length of list_pids : 19 ; length of list_args : 19 time to download the photos : 3.2813704013824463 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Feb 19 07:50:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1997 wait 20 seconds l 3637 free memory gpu now : 1997 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-02-19 07:50:55.490348: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-02-19 07:50:55.518523: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-02-19 07:50:55.520239: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7eff08000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-02-19 07:50:55.520289: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-02-19 07:50:55.522916: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-02-19 07:50:55.650081: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x20d15640 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-02-19 07:50:55.650118: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-02-19 07:50:55.650805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-02-19 07:50:55.651100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-02-19 07:50:55.653051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-02-19 07:50:55.655191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-02-19 07:50:55.655529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-02-19 07:50:55.657797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-02-19 07:50:55.658898: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-02-19 07:50:55.663521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-02-19 07:50:55.664465: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-02-19 07:50:55.664540: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-02-19 07:50:55.665051: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-02-19 07:50:55.665084: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-02-19 07:50:55.665094: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-02-19 07:50:55.665878: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1620 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-02-19 07:50:55.924710: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-02-19 07:50:55.924800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-02-19 07:50:55.924827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-02-19 07:50:55.924846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-02-19 07:50:55.924864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-02-19 07:50:55.924882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-02-19 07:50:55.924900: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-02-19 07:50:55.924917: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-02-19 07:50:55.925840: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-02-19 07:50:55.926759: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-02-19 07:50:55.926794: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-02-19 07:50:55.926813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-02-19 07:50:55.926830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-02-19 07:50:55.926847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-02-19 07:50:55.926864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-02-19 07:50:55.926880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-02-19 07:50:55.926896: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-02-19 07:50:55.927790: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-02-19 07:50:55.927820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-02-19 07:50:55.927831: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-02-19 07:50:55.927840: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-02-19 07:50:55.928789: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1620 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-02-19 07:51:03.674257: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-02-19 07:51:03.855683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-02-19 07:51:05.040795: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.040857: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.047276: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.047298: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.096477: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.096550: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.138130: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.138161: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.189153: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.189185: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-02-19 07:51:05.190840: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2026-02-19 07:51:05.207965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.209005: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.236789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.237305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.238771: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.239257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.245595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.246082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.251462: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.251947: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.253364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.253846: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.279264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.279756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.280233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.280710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.284045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.284528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.299505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.299992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.300484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.300961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.312961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.313444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.313921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.314415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.318488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.318973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.323523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.324006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.336132: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.336614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.340704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.341184: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.341805: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.342294: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.352963: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.353444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.353935: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.354419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.354898: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.355374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.412344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.412870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.420632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.421120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.436852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.437529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.438189: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.438847: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.443023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.443679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.444197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.444677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.445503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.445519: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2026-02-19 07:51:05.455952: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.456438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.465356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.465863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.466475: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.467012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.467549: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-02-19 07:51:05.468056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.08G (1163460608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 19 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 2049290 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 804 tf kernel not reseted sub process len(results) : 19 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 19 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1997 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [264, 1794, 501, 1920] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 9732 time to create 1 rle with old method : 0.0103607177734375 length of segment : 200 DEBUG bbox = [933, 687, 1074, 840] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 14801 time to create 1 rle with old method : 0.016205787658691406 length of segment : 149 DEBUG bbox = [837, 909, 939, 1050] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 7159 time to create 1 rle with old method : 0.008282899856567383 length of segment : 76 DEBUG bbox = [3, 1434, 57, 1557] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 4604 time to create 1 rle with old method : 0.005270242691040039 length of segment : 50 DEBUG bbox = [888, 378, 1035, 528] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 8884 time to create 1 rle with old method : 0.009854555130004883 length of segment : 110 DEBUG bbox = [273, 1026, 438, 1128] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00016117095947265625 nb_pixel_total : 9884 time to create 1 rle with old method : 0.010673761367797852 length of segment : 143 DEBUG bbox = [3, 1176, 51, 1275] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 3411 time to create 1 rle with old method : 0.003814220428466797 length of segment : 44 DEBUG bbox = [939, 516, 1062, 726] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 16126 time to create 1 rle with old method : 0.01746082305908203 length of segment : 129 DEBUG bbox = [492, 1212, 654, 1362] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00019311904907226562 nb_pixel_total : 10286 time to create 1 rle with old method : 0.011522293090820312 length of segment : 143 DEBUG bbox = [963, 1242, 1080, 1371] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001373291015625 nb_pixel_total : 8117 time to create 1 rle with old method : 0.00888967514038086 length of segment : 102 DEBUG bbox = [849, 1518, 918, 1581] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 2501 time to create 1 rle with old method : 0.002892017364501953 length of segment : 64 DEBUG bbox = [171, 957, 333, 1062] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001480579376220703 nb_pixel_total : 8619 time to create 1 rle with old method : 0.009628772735595703 length of segment : 159 DEBUG bbox = [855, 1440, 1062, 1581] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003173351287841797 nb_pixel_total : 20535 time to create 1 rle with old method : 0.02181696891784668 length of segment : 192 DEBUG bbox = [519, 1020, 612, 1107] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 5789 time to create 1 rle with old method : 0.006613731384277344 length of segment : 88 DEBUG bbox = [123, 1167, 285, 1257] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 9224 time to create 1 rle with old method : 0.01015615463256836 length of segment : 157 DEBUG bbox = [891, 822, 1065, 963] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002117156982421875 nb_pixel_total : 14240 time to create 1 rle with old method : 0.01488637924194336 length of segment : 164 DEBUG bbox = [930, 1218, 1053, 1326] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001323223114013672 nb_pixel_total : 8148 time to create 1 rle with old method : 0.00894021987915039 length of segment : 122 DEBUG bbox = [1002, 1011, 1071, 1134] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 4936 time to create 1 rle with old method : 0.005515575408935547 length of segment : 66 DEBUG bbox = [234, 1527, 366, 1617] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 7852 time to create 1 rle with old method : 0.008626937866210938 length of segment : 129 DEBUG bbox = [210, 1140, 342, 1275] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 13466 time to create 1 rle with old method : 0.014821767807006836 length of segment : 128 DEBUG bbox = [93, 1320, 231, 1410] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001456737518310547 nb_pixel_total : 8100 time to create 1 rle with old method : 0.009002923965454102 length of segment : 129 DEBUG bbox = [873, 549, 1080, 804] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00036406517028808594 nb_pixel_total : 15675 time to create 1 rle with old method : 0.017330169677734375 length of segment : 253 DEBUG bbox = [93, 1104, 333, 1296] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003154277801513672 nb_pixel_total : 17566 time to create 1 rle with old method : 0.018978595733642578 length of segment : 171 DEBUG bbox = [258, 1560, 480, 1740] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003116130828857422 nb_pixel_total : 15495 time to create 1 rle with old method : 0.016739845275878906 length of segment : 209 DEBUG bbox = [999, 1281, 1068, 1344] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 2713 time to create 1 rle with old method : 0.0030527114868164062 length of segment : 63 DEBUG bbox = [882, 1212, 951, 1269] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 2720 time to create 1 rle with old method : 0.002966642379760742 length of segment : 69 DEBUG bbox = [267, 1374, 531, 1560] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003523826599121094 nb_pixel_total : 23741 time to create 1 rle with old method : 0.025162458419799805 length of segment : 229 DEBUG bbox = [309, 1698, 579, 1893] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0004181861877441406 nb_pixel_total : 32110 time to create 1 rle with old method : 0.03486061096191406 length of segment : 266 DEBUG bbox = [0, 0, 1035, 1173] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.012275457382202148 nb_pixel_total : 770364 time to create 1 rle with new method : 0.051882028579711914 length of segment : 993 DEBUG bbox = [123, 1128, 219, 1209] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 5255 time to create 1 rle with old method : 0.005780696868896484 length of segment : 92 DEBUG bbox = [816, 849, 885, 969] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 5426 time to create 1 rle with old method : 0.005991935729980469 length of segment : 66 DEBUG bbox = [720, 867, 816, 957] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 4668 time to create 1 rle with old method : 0.00511622428894043 length of segment : 83 DEBUG bbox = [591, 573, 876, 891] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0004756450653076172 nb_pixel_total : 19613 time to create 1 rle with old method : 0.022038936614990234 length of segment : 228 DEBUG bbox = [831, 906, 1005, 1104] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00024080276489257812 nb_pixel_total : 12435 time to create 1 rle with old method : 0.013392925262451172 length of segment : 132 DEBUG bbox = [792, 1020, 915, 1119] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 5023 time to create 1 rle with old method : 0.005671262741088867 length of segment : 113 DEBUG bbox = [924, 747, 1071, 867] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00018358230590820312 nb_pixel_total : 11364 time to create 1 rle with old method : 0.01244974136352539 length of segment : 182 DEBUG bbox = [315, 1137, 465, 1263] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001728534698486328 nb_pixel_total : 11215 time to create 1 rle with old method : 0.012157678604125977 length of segment : 171 DEBUG bbox = [474, 891, 549, 966] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 3784 time to create 1 rle with old method : 0.004377841949462891 length of segment : 70 DEBUG bbox = [3, 1602, 123, 1713] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 8294 time to create 1 rle with old method : 0.009047985076904297 length of segment : 148 DEBUG bbox = [438, 1776, 603, 1887] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001723766326904297 nb_pixel_total : 10412 time to create 1 rle with old method : 0.011100530624389648 length of segment : 169 DEBUG bbox = [897, 468, 1080, 762] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0004642009735107422 nb_pixel_total : 41395 time to create 1 rle with old method : 0.04443097114562988 length of segment : 167 DEBUG bbox = [327, 1164, 465, 1275] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001595020294189453 nb_pixel_total : 9752 time to create 1 rle with old method : 0.01497197151184082 length of segment : 131 DEBUG bbox = [144, 1503, 432, 1746] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0009534358978271484 nb_pixel_total : 37582 time to create 1 rle with old method : 0.03939509391784668 length of segment : 254 DEBUG bbox = [6, 1509, 189, 1638] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0004227161407470703 nb_pixel_total : 15207 time to create 1 rle with old method : 0.016454458236694336 length of segment : 184 DEBUG bbox = [54, 1242, 201, 1362] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003364086151123047 nb_pixel_total : 8561 time to create 1 rle with old method : 0.009528875350952148 length of segment : 142 DEBUG bbox = [81, 1365, 228, 1467] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 5150 time to create 1 rle with old method : 0.005674600601196289 length of segment : 94 DEBUG bbox = [798, 537, 1050, 699] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006058216094970703 nb_pixel_total : 18740 time to create 1 rle with old method : 0.020350217819213867 length of segment : 230 DEBUG bbox = [228, 1227, 378, 1320] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00031185150146484375 nb_pixel_total : 5432 time to create 1 rle with old method : 0.006451845169067383 length of segment : 149 DEBUG bbox = [195, 1770, 453, 1911] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006146430969238281 nb_pixel_total : 18535 time to create 1 rle with old method : 0.020772695541381836 length of segment : 261 DEBUG bbox = [36, 1548, 273, 1731] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005824565887451172 nb_pixel_total : 26369 time to create 1 rle with old method : 0.030678510665893555 length of segment : 226 DEBUG bbox = [0, 1359, 120, 1440] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002503395080566406 nb_pixel_total : 6159 time to create 1 rle with old method : 0.0070531368255615234 length of segment : 114 DEBUG bbox = [906, 948, 1074, 1128] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002827644348144531 nb_pixel_total : 21060 time to create 1 rle with old method : 0.02341485023498535 length of segment : 159 DEBUG bbox = [828, 1029, 921, 1119] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011682510375976562 nb_pixel_total : 6890 time to create 1 rle with old method : 0.007802248001098633 length of segment : 94 DEBUG bbox = [876, 1092, 1080, 1413] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006113052368164062 nb_pixel_total : 43916 time to create 1 rle with old method : 0.04767346382141113 length of segment : 197 time spent for convertir_results : 2.0444891452789307 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 54 chid ids of type : 3594 Number RLEs to save : 8653 save missing photos in datou_result : time spend for datou_step_exec : 46.33557057380676 time spend to save output : 0.7572550773620605 total time spend for step 1 : 47.09282565116882 step2:crop_condition Thu Feb 19 07:51:19 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 19 ! batch 1 Loaded 54 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1771483881_2048797 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392056061_8783fece12d2c9bf46428c806eebfc2d_rle_crop_4136681345_0.png', 0, 110, 200, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055920_4d1f775121e30f30517979ff36ee093c_rle_crop_4136681347_0.png', 0, 139, 76, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681349_0.png', 0, 140, 110, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681354_0.png', 0, 112, 102, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681359_0.png', 0, 86, 157, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681361_0.png', 0, 92, 121, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681362_0.png', 0, 113, 66, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681365_0.png', 0, 85, 125, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681366_0.png', 0, 220, 154, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681368_0.png', 0, 166, 209, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681369_0.png', 0, 61, 63, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681370_0.png', 0, 53, 69, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681374_0.png', 0, 75, 91, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055337_f28c4b54b4ae8b18cd8ddc19f77e500a_rle_crop_4136681375_0.png', 0, 114, 65, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055337_f28c4b54b4ae8b18cd8ddc19f77e500a_rle_crop_4136681376_0.png', 0, 76, 82, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055301_9bbd1fb70397de8757e43c3185b72ef8_rle_crop_4136681377_0.png', 0, 289, 213, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055264_c277ff19775588b955f99d5b21844541_rle_crop_4136681378_0.png', 0, 167, 132, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055264_c277ff19775588b955f99d5b21844541_rle_crop_4136681379_0.png', 0, 93, 96, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055070_f1513d223be1634234c5c62777a7c8ac_rle_crop_4136681380_0.png', 0, 105, 145, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055070_f1513d223be1634234c5c62777a7c8ac_rle_crop_4136681381_0.png', 0, 125, 134, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681382_0.png', 0, 74, 70, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681386_0.png', 0, 105, 131, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054968_7ef6331d691fe9d822bab60384147fe1_rle_crop_4136681389_0.png', 0, 109, 142, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054968_7ef6331d691fe9d822bab60384147fe1_rle_crop_4136681390_0.png', 0, 93, 94, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681392_0.png', 0, 91, 126, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483886), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681397_0.png', 0, 85, 93, 0, 1771483886,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.383680105209351 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1771483888_2048797 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483889), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681353_0.png', 0, 119, 143, 0, 1771483889,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483889), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681384_0.png', 0, 106, 151, 0, 1771483889,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8312077522277832 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3736932 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1771483894_2048797 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392056061_8783fece12d2c9bf46428c806eebfc2d_rle_crop_4136681346_0.png', 0, 141, 134, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681348_0.png', 0, 109, 49, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681350_0.png', 0, 101, 143, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055912_b61ba8c12fc8c6730abcd95f757ee01a_rle_crop_4136681351_0.png', 0, 94, 44, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681352_0.png', 0, 186, 121, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681355_0.png', 0, 49, 64, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681356_0.png', 0, 86, 159, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055907_36f69acb91553eba83c7bdf78006e5f5_rle_crop_4136681357_0.png', 0, 136, 192, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681360_0.png', 0, 125, 162, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681363_0.png', 0, 82, 129, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681364_0.png', 0, 128, 128, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055408_53d90fda6a26e11d112383de3b4c7518_rle_crop_4136681367_0.png', 0, 172, 162, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681371_0.png', 0, 143, 222, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681372_0.png', 0, 195, 241, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681373_0.png', 0, 1120, 989, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681383_0.png', 0, 102, 114, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681385_0.png', 0, 290, 163, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681387_0.png', 0, 204, 252, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055001_27b1973d254ff0833422611dc4594de6_rle_crop_4136681388_0.png', 0, 108, 181, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681391_0.png', 0, 141, 230, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681393_0.png', 0, 130, 233, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681394_0.png', 0, 176, 214, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681395_0.png', 0, 80, 113, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681396_0.png', 0, 168, 158, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483898), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681398_0.png', 0, 285, 195, 0, 1771483898,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 25 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.877909898757935 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1771483900_2048797 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1771483900), 0.0, 0.0, 14, '', 0, 0, '1771483829_2048797_1392055907_36f69acb91553eba83c7bdf78006e5f5_rle_crop_4136681358_0.png', 0, 83, 87, 0, 1771483900,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5125563144683838 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1392056061, 1392055920, 1392055916, 1392055912, 1392055910, 1392055907, 1392055903, 1392055446, 1392055408, 1392055372, 1392055337, 1392055301, 1392055264, 1392055070, 1392055036, 1392055001, 1392054968, 1392054931, 1392054892] Looping around the photos to save general results len do output : 54 /1408896310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1408896423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392056061', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055920', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055916', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055912', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055910', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055907', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055903', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055446', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055408', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055372', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055337', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055301', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055264', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055070', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055036', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055001', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054968', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054931', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054892', None, None, None, None, None, '4348464') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 181 time used for this insertion : 0.031243324279785156 save_final save missing photos in datou_result : time spend for datou_step_exec : 21.16739773750305 time spend to save output : 0.033632516860961914 total time spend for step 2 : 21.201030254364014 step3:rle_unique_nms_with_priority Thu Feb 19 07:51:41 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 54 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.33191752433776855 time for calcul the mask position with numpy : 0.06952643394470215 nb_pixel_total : 2049067 time to create 1 rle with new method : 0.3932654857635498 time for calcul the mask position with numpy : 0.006089925765991211 nb_pixel_total : 14801 time to create 1 rle with old method : 0.015329599380493164 time for calcul the mask position with numpy : 0.006206512451171875 nb_pixel_total : 9732 time to create 1 rle with old method : 0.010240793228149414 create new chi : 0.5101416110992432 time to delete rle : 0.030364274978637695 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1778 TO DO : save crop sub photo not yet done ! save time : 0.18055510520935059 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07221674919128418 time for calcul the mask position with numpy : 0.026372432708740234 nb_pixel_total : 2066441 time to create 1 rle with new method : 0.20788812637329102 time for calcul the mask position with numpy : 0.00598907470703125 nb_pixel_total : 7159 time to create 1 rle with old method : 0.007481813430786133 create new chi : 0.25432395935058594 time to delete rle : 0.00020456314086914062 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1232 TO DO : save crop sub photo not yet done ! save time : 0.13909411430358887 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07826590538024902 time for calcul the mask position with numpy : 0.21694517135620117 nb_pixel_total : 2050228 time to create 1 rle with new method : 0.08188295364379883 time for calcul the mask position with numpy : 0.006060123443603516 nb_pixel_total : 9884 time to create 1 rle with old method : 0.010415792465209961 time for calcul the mask position with numpy : 0.006025075912475586 nb_pixel_total : 8884 time to create 1 rle with old method : 0.00930643081665039 time for calcul the mask position with numpy : 0.006418466567993164 nb_pixel_total : 4604 time to create 1 rle with old method : 0.0049746036529541016 create new chi : 0.35341978073120117 time to delete rle : 0.0002923011779785156 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1686 TO DO : save crop sub photo not yet done ! save time : 0.18515515327453613 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032691240310668945 time for calcul the mask position with numpy : 0.0195310115814209 nb_pixel_total : 2070189 time to create 1 rle with new method : 0.21283340454101562 time for calcul the mask position with numpy : 0.006184101104736328 nb_pixel_total : 3411 time to create 1 rle with old method : 0.003751039505004883 create new chi : 0.24889326095581055 time to delete rle : 0.00019979476928710938 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1168 TO DO : save crop sub photo not yet done ! save time : 0.14713573455810547 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.5797467231750488 time for calcul the mask position with numpy : 0.21971392631530762 nb_pixel_total : 2027951 time to create 1 rle with new method : 0.28601884841918945 time for calcul the mask position with numpy : 0.00996541976928711 nb_pixel_total : 8619 time to create 1 rle with old method : 0.009185075759887695 time for calcul the mask position with numpy : 0.00955343246459961 nb_pixel_total : 2501 time to create 1 rle with old method : 0.00274658203125 time for calcul the mask position with numpy : 0.009924173355102539 nb_pixel_total : 8117 time to create 1 rle with old method : 0.008635520935058594 time for calcul the mask position with numpy : 0.009407281875610352 nb_pixel_total : 10286 time to create 1 rle with old method : 0.011141300201416016 time for calcul the mask position with numpy : 0.009423971176147461 nb_pixel_total : 16126 time to create 1 rle with old method : 0.017820119857788086 create new chi : 0.6128842830657959 time to delete rle : 0.0004553794860839844 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2274 TO DO : save crop sub photo not yet done ! save time : 0.23710966110229492 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04917478561401367 time for calcul the mask position with numpy : 0.0209043025970459 nb_pixel_total : 2047276 time to create 1 rle with new method : 0.07284998893737793 time for calcul the mask position with numpy : 0.0057849884033203125 nb_pixel_total : 5789 time to create 1 rle with old method : 0.006230592727661133 time for calcul the mask position with numpy : 0.005910158157348633 nb_pixel_total : 20535 time to create 1 rle with old method : 0.021320343017578125 create new chi : 0.13326692581176758 time to delete rle : 0.00026226043701171875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1640 TO DO : save crop sub photo not yet done ! save time : 0.17165112495422363 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.11191797256469727 time for calcul the mask position with numpy : 0.07172012329101562 nb_pixel_total : 2029200 time to create 1 rle with new method : 0.20863795280456543 time for calcul the mask position with numpy : 0.005706787109375 nb_pixel_total : 7852 time to create 1 rle with old method : 0.00850367546081543 time for calcul the mask position with numpy : 0.0059010982513427734 nb_pixel_total : 4936 time to create 1 rle with old method : 0.005293369293212891 time for calcul the mask position with numpy : 0.005802631378173828 nb_pixel_total : 8148 time to create 1 rle with old method : 0.00883173942565918 time for calcul the mask position with numpy : 0.005774021148681641 nb_pixel_total : 14240 time to create 1 rle with old method : 0.015430688858032227 time for calcul the mask position with numpy : 0.006095170974731445 nb_pixel_total : 9224 time to create 1 rle with old method : 0.011593103408813477 create new chi : 0.36943626403808594 time to delete rle : 0.00040268898010253906 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2356 TO DO : save crop sub photo not yet done ! save time : 0.22941803932189941 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04857015609741211 time for calcul the mask position with numpy : 0.0185394287109375 nb_pixel_total : 2036359 time to create 1 rle with new method : 0.198380708694458 time for calcul the mask position with numpy : 0.005995512008666992 nb_pixel_total : 15675 time to create 1 rle with old method : 0.016738176345825195 time for calcul the mask position with numpy : 0.00572514533996582 nb_pixel_total : 8100 time to create 1 rle with old method : 0.008684158325195312 time for calcul the mask position with numpy : 0.0056040287017822266 nb_pixel_total : 13466 time to create 1 rle with old method : 0.014489173889160156 create new chi : 0.2805969715118408 time to delete rle : 0.0003445148468017578 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 2100 TO DO : save crop sub photo not yet done ! save time : 0.23140788078308105 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.06865310668945312 time for calcul the mask position with numpy : 0.15448522567749023 nb_pixel_total : 2056034 time to create 1 rle with new method : 0.08373308181762695 time for calcul the mask position with numpy : 0.005986452102661133 nb_pixel_total : 17566 time to create 1 rle with old method : 0.018581390380859375 create new chi : 0.27294135093688965 time to delete rle : 0.00022554397583007812 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1422 TO DO : save crop sub photo not yet done ! save time : 0.17336297035217285 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.44692397117614746 time for calcul the mask position with numpy : 0.29300665855407715 nb_pixel_total : 1221290 time to create 1 rle with new method : 0.08411502838134766 time for calcul the mask position with numpy : 0.0059719085693359375 nb_pixel_total : 5167 time to create 1 rle with old method : 0.005461454391479492 time for calcul the mask position with numpy : 0.0162203311920166 nb_pixel_total : 770364 time to create 1 rle with new method : 0.19441604614257812 time for calcul the mask position with numpy : 0.006631374359130859 nb_pixel_total : 32110 time to create 1 rle with old method : 0.034967660903930664 time for calcul the mask position with numpy : 0.00607609748840332 nb_pixel_total : 23741 time to create 1 rle with old method : 0.02507162094116211 time for calcul the mask position with numpy : 0.00618743896484375 nb_pixel_total : 2720 time to create 1 rle with old method : 0.003857135772705078 time for calcul the mask position with numpy : 0.006229877471923828 nb_pixel_total : 2713 time to create 1 rle with old method : 0.0030791759490966797 time for calcul the mask position with numpy : 0.00596308708190918 nb_pixel_total : 15495 time to create 1 rle with old method : 0.016747713088989258 create new chi : 0.7238175868988037 time to delete rle : 0.0006151199340820312 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 4875 TO DO : save crop sub photo not yet done ! save time : 0.37787508964538574 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.041130781173706055 time for calcul the mask position with numpy : 0.019199848175048828 nb_pixel_total : 2063506 time to create 1 rle with new method : 0.02737259864807129 time for calcul the mask position with numpy : 0.005987405776977539 nb_pixel_total : 4668 time to create 1 rle with old method : 0.004925727844238281 time for calcul the mask position with numpy : 0.005835533142089844 nb_pixel_total : 5426 time to create 1 rle with old method : 0.006974458694458008 create new chi : 0.08348894119262695 time to delete rle : 0.00027179718017578125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1378 TO DO : save crop sub photo not yet done ! save time : 0.13744497299194336 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.255842924118042 time for calcul the mask position with numpy : 0.06959056854248047 nb_pixel_total : 2053987 time to create 1 rle with new method : 0.26076436042785645 time for calcul the mask position with numpy : 0.00606083869934082 nb_pixel_total : 19613 time to create 1 rle with old method : 0.020928621292114258 create new chi : 0.3672025203704834 time to delete rle : 0.00022649765014648438 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1536 TO DO : save crop sub photo not yet done ! save time : 0.15834403038024902 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06412005424499512 time for calcul the mask position with numpy : 0.19739651679992676 nb_pixel_total : 2056142 time to create 1 rle with new method : 0.2328801155090332 time for calcul the mask position with numpy : 0.006075143814086914 nb_pixel_total : 5023 time to create 1 rle with old method : 0.005307912826538086 time for calcul the mask position with numpy : 0.0061457157135009766 nb_pixel_total : 12435 time to create 1 rle with old method : 0.013549327850341797 create new chi : 0.471172571182251 time to delete rle : 0.00027108192443847656 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1570 TO DO : save crop sub photo not yet done ! save time : 0.18847107887268066 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04088139533996582 time for calcul the mask position with numpy : 0.06587648391723633 nb_pixel_total : 2051021 time to create 1 rle with new method : 0.5462217330932617 time for calcul the mask position with numpy : 0.005873680114746094 nb_pixel_total : 11215 time to create 1 rle with old method : 0.01173090934753418 time for calcul the mask position with numpy : 0.005945920944213867 nb_pixel_total : 11364 time to create 1 rle with old method : 0.012364387512207031 create new chi : 0.657829761505127 time to delete rle : 0.0002911090850830078 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1786 TO DO : save crop sub photo not yet done ! save time : 0.1802527904510498 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.4355645179748535 time for calcul the mask position with numpy : 0.06857419013977051 nb_pixel_total : 1962381 time to create 1 rle with new method : 0.2109072208404541 time for calcul the mask position with numpy : 0.011050224304199219 nb_pixel_total : 37582 time to create 1 rle with old method : 0.04115486145019531 time for calcul the mask position with numpy : 0.006165742874145508 nb_pixel_total : 9752 time to create 1 rle with old method : 0.010404825210571289 time for calcul the mask position with numpy : 0.0062525272369384766 nb_pixel_total : 41395 time to create 1 rle with old method : 0.04362773895263672 time for calcul the mask position with numpy : 0.006007194519042969 nb_pixel_total : 10412 time to create 1 rle with old method : 0.011467456817626953 time for calcul the mask position with numpy : 0.005819797515869141 nb_pixel_total : 8294 time to create 1 rle with old method : 0.00858306884765625 time for calcul the mask position with numpy : 0.0059051513671875 nb_pixel_total : 3784 time to create 1 rle with old method : 0.003942728042602539 create new chi : 0.4527628421783447 time to delete rle : 0.00047016143798828125 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 2958 TO DO : save crop sub photo not yet done ! save time : 0.3034701347351074 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0667271614074707 time for calcul the mask position with numpy : 0.01858234405517578 nb_pixel_total : 2058393 time to create 1 rle with new method : 0.02869105339050293 time for calcul the mask position with numpy : 0.005643129348754883 nb_pixel_total : 15207 time to create 1 rle with old method : 0.016135215759277344 create new chi : 0.06930422782897949 time to delete rle : 0.0002186298370361328 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1448 TO DO : save crop sub photo not yet done ! save time : 0.15792155265808105 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04311490058898926 time for calcul the mask position with numpy : 0.019304513931274414 nb_pixel_total : 2059889 time to create 1 rle with new method : 0.02759838104248047 time for calcul the mask position with numpy : 0.005753278732299805 nb_pixel_total : 5150 time to create 1 rle with old method : 0.0054514408111572266 time for calcul the mask position with numpy : 0.005849599838256836 nb_pixel_total : 8561 time to create 1 rle with old method : 0.009150028228759766 create new chi : 0.07334685325622559 time to delete rle : 0.0002834796905517578 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1552 TO DO : save crop sub photo not yet done ! save time : 0.16891789436340332 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.4320499897003174 time for calcul the mask position with numpy : 0.062421321868896484 nb_pixel_total : 2004524 time to create 1 rle with new method : 0.17981219291687012 time for calcul the mask position with numpy : 0.006576061248779297 nb_pixel_total : 26369 time to create 1 rle with old method : 0.02779388427734375 time for calcul the mask position with numpy : 0.005933523178100586 nb_pixel_total : 18535 time to create 1 rle with old method : 0.019411087036132812 time for calcul the mask position with numpy : 0.005677938461303711 nb_pixel_total : 5432 time to create 1 rle with old method : 0.005515336990356445 time for calcul the mask position with numpy : 0.006070137023925781 nb_pixel_total : 18740 time to create 1 rle with old method : 0.019668102264404297 create new chi : 0.34859132766723633 time to delete rle : 0.00030803680419921875 batch 1 Loaded 9 chid ids of type : 3594 ++++++++Number RLEs to save : 2812 TO DO : save crop sub photo not yet done ! save time : 0.2608659267425537 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06542634963989258 time for calcul the mask position with numpy : 0.10377287864685059 nb_pixel_total : 1995575 time to create 1 rle with new method : 0.0904703140258789 time for calcul the mask position with numpy : 0.005841970443725586 nb_pixel_total : 43916 time to create 1 rle with old method : 0.04608345031738281 time for calcul the mask position with numpy : 0.005724668502807617 nb_pixel_total : 6890 time to create 1 rle with old method : 0.0076215267181396484 time for calcul the mask position with numpy : 0.005869865417480469 nb_pixel_total : 21060 time to create 1 rle with old method : 0.02263951301574707 time for calcul the mask position with numpy : 0.0057909488677978516 nb_pixel_total : 6159 time to create 1 rle with old method : 0.00629425048828125 create new chi : 0.310499906539917 time to delete rle : 0.000347137451171875 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2208 TO DO : save crop sub photo not yet done ! save time : 0.20578718185424805 map_output_result : {1392056061: (0.0, 'Should be the crop_list due to order', 0), 1392055920: (0.0, 'Should be the crop_list due to order', 0), 1392055916: (0.0, 'Should be the crop_list due to order', 0), 1392055912: (0.0, 'Should be the crop_list due to order', 0), 1392055910: (0.0, 'Should be the crop_list due to order', 0), 1392055907: (0.0, 'Should be the crop_list due to order', 0), 1392055903: (0.0, 'Should be the crop_list due to order', 0), 1392055446: (0.0, 'Should be the crop_list due to order', 0), 1392055408: (0.0, 'Should be the crop_list due to order', 0), 1392055372: (0.0, 'Should be the crop_list due to order', 0), 1392055337: (0.0, 'Should be the crop_list due to order', 0), 1392055301: (0.0, 'Should be the crop_list due to order', 0), 1392055264: (0.0, 'Should be the crop_list due to order', 0), 1392055070: (0.0, 'Should be the crop_list due to order', 0), 1392055036: (0.0, 'Should be the crop_list due to order', 0), 1392055001: (0.0, 'Should be the crop_list due to order', 0), 1392054968: (0.0, 'Should be the crop_list due to order', 0), 1392054931: (0.0, 'Should be the crop_list due to order', 0), 1392054892: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1392056061, 1392055920, 1392055916, 1392055912, 1392055910, 1392055907, 1392055903, 1392055446, 1392055408, 1392055372, 1392055337, 1392055301, 1392055264, 1392055070, 1392055036, 1392055001, 1392054968, 1392054931, 1392054892] Looping around the photos to save general results len do output : 19 /1392056061.Didn't retrieve data . /1392055920.Didn't retrieve data . /1392055916.Didn't retrieve data . /1392055912.Didn't retrieve data . /1392055910.Didn't retrieve data . /1392055907.Didn't retrieve data . /1392055903.Didn't retrieve data . /1392055446.Didn't retrieve data . /1392055408.Didn't retrieve data . /1392055372.Didn't retrieve data . /1392055337.Didn't retrieve data . /1392055301.Didn't retrieve data . /1392055264.Didn't retrieve data . /1392055070.Didn't retrieve data . /1392055036.Didn't retrieve data . /1392055001.Didn't retrieve data . /1392054968.Didn't retrieve data . /1392054931.Didn't retrieve data . /1392054892.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392056061', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055920', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055916', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055912', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055910', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055907', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055903', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055446', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055408', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055372', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055337', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055301', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055264', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055070', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055036', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055001', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054968', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054931', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054892', None, None, None, None, None, '4348464') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 57 time used for this insertion : 0.01902604103088379 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.403441905975342 time spend to save output : 0.01960301399230957 total time spend for step 3 : 14.423044919967651 step4:ventilate_hashtags_in_portfolio Thu Feb 19 07:51:55 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30454598 get user id for portfolio 30454598 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30454598 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','flou','pehd','autre','environnement','carton','metal','background','papier','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30454598 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','flou','pehd','autre','environnement','carton','metal','background','papier','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30457427,30457428,30457429,30457430,30457431,30457432,30457433,30457434,30457435,30457436,30457437?tags=pet_fonce,pehd,papier,pet_clair,environnement,flou,background,metal,mal_croppe,autre,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1392056061, 1392055920, 1392055916, 1392055912, 1392055910, 1392055907, 1392055903, 1392055446, 1392055408, 1392055372, 1392055337, 1392055301, 1392055264, 1392055070, 1392055036, 1392055001, 1392054968, 1392054931, 1392054892] Looping around the photos to save general results len do output : 1 /30454598. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392056061', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055920', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055916', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055912', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055910', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055907', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055903', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055446', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055408', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055372', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055337', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055301', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055264', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055070', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055036', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055001', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054968', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054931', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054892', None, None, None, None, None, '4348464') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.01782393455505371 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5197830200195312 time spend to save output : 0.018105268478393555 total time spend for step 4 : 0.5378882884979248 step5:final Thu Feb 19 07:51:56 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1392056061: ('0.06875782230853733',), 1392055920: ('0.06875782230853733',), 1392055916: ('0.06875782230853733',), 1392055912: ('0.06875782230853733',), 1392055910: ('0.06875782230853733',), 1392055907: ('0.06875782230853733',), 1392055903: ('0.06875782230853733',), 1392055446: ('0.06875782230853733',), 1392055408: ('0.06875782230853733',), 1392055372: ('0.06875782230853733',), 1392055337: ('0.06875782230853733',), 1392055301: ('0.06875782230853733',), 1392055264: ('0.06875782230853733',), 1392055070: ('0.06875782230853733',), 1392055036: ('0.06875782230853733',), 1392055001: ('0.06875782230853733',), 1392054968: ('0.06875782230853733',), 1392054931: ('0.06875782230853733',), 1392054892: ('0.06875782230853733',)} new output for save of step final : {1392056061: ('0.06875782230853733',), 1392055920: ('0.06875782230853733',), 1392055916: ('0.06875782230853733',), 1392055912: ('0.06875782230853733',), 1392055910: ('0.06875782230853733',), 1392055907: ('0.06875782230853733',), 1392055903: ('0.06875782230853733',), 1392055446: ('0.06875782230853733',), 1392055408: ('0.06875782230853733',), 1392055372: ('0.06875782230853733',), 1392055337: ('0.06875782230853733',), 1392055301: ('0.06875782230853733',), 1392055264: ('0.06875782230853733',), 1392055070: ('0.06875782230853733',), 1392055036: ('0.06875782230853733',), 1392055001: ('0.06875782230853733',), 1392054968: ('0.06875782230853733',), 1392054931: ('0.06875782230853733',), 1392054892: ('0.06875782230853733',)} [1392056061, 1392055920, 1392055916, 1392055912, 1392055910, 1392055907, 1392055903, 1392055446, 1392055408, 1392055372, 1392055337, 1392055301, 1392055264, 1392055070, 1392055036, 1392055001, 1392054968, 1392054931, 1392054892] Looping around the photos to save general results len do output : 19 /1392056061.Didn't retrieve data . /1392055920.Didn't retrieve data . /1392055916.Didn't retrieve data . /1392055912.Didn't retrieve data . /1392055910.Didn't retrieve data . /1392055907.Didn't retrieve data . /1392055903.Didn't retrieve data . /1392055446.Didn't retrieve data . /1392055408.Didn't retrieve data . /1392055372.Didn't retrieve data . /1392055337.Didn't retrieve data . /1392055301.Didn't retrieve data . /1392055264.Didn't retrieve data . /1392055070.Didn't retrieve data . /1392055036.Didn't retrieve data . /1392055001.Didn't retrieve data . /1392054968.Didn't retrieve data . /1392054931.Didn't retrieve data . /1392054892.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392056061', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055920', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055916', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055912', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055910', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055907', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055903', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055446', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055408', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055372', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055337', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055301', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055264', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055070', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055036', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055001', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054968', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054931', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054892', None, None, None, None, None, '4348464') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 57 time used for this insertion : 0.01928114891052246 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14579081535339355 time spend to save output : 0.02007317543029785 total time spend for step 5 : 0.1658639907836914 step6:blur_detection Thu Feb 19 07:51:56 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1771483829_2048797_1392056061_8783fece12d2c9bf46428c806eebfc2d.jpg resize: (1080, 1920) 1392056061 1.136669740242657 treat image : temp/1771483829_2048797_1392055920_4d1f775121e30f30517979ff36ee093c.jpg resize: (1080, 1920) 1392055920 0.31801467320147625 treat image : temp/1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1.jpg resize: (1080, 1920) 1392055916 0.48092556083981863 treat image : temp/1771483829_2048797_1392055912_b61ba8c12fc8c6730abcd95f757ee01a.jpg resize: (1080, 1920) 1392055912 -0.03584633798557356 treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531.jpg resize: (1080, 1920) 1392055910 0.7221898399787566 treat image : temp/1771483829_2048797_1392055907_36f69acb91553eba83c7bdf78006e5f5.jpg resize: (1080, 1920) 1392055907 0.3052892837475883 treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79.jpg resize: (1080, 1920) 1392055903 0.7269978283875363 treat image : temp/1771483829_2048797_1392055446_42ca403780c522d327793519a93badab.jpg resize: (1080, 1920) 1392055446 0.09835135430802967 treat image : temp/1771483829_2048797_1392055408_53d90fda6a26e11d112383de3b4c7518.jpg resize: (1080, 1920) 1392055408 0.45518867977618815 treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389.jpg resize: (1080, 1920) 1392055372 0.139509095529497 treat image : temp/1771483829_2048797_1392055337_f28c4b54b4ae8b18cd8ddc19f77e500a.jpg resize: (1080, 1920) 1392055337 0.9240076312974841 treat image : temp/1771483829_2048797_1392055301_9bbd1fb70397de8757e43c3185b72ef8.jpg resize: (1080, 1920) 1392055301 0.3893779733377987 treat image : temp/1771483829_2048797_1392055264_c277ff19775588b955f99d5b21844541.jpg resize: (1080, 1920) 1392055264 0.9890622889837195 treat image : temp/1771483829_2048797_1392055070_f1513d223be1634234c5c62777a7c8ac.jpg resize: (1080, 1920) 1392055070 0.3498557726996632 treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5.jpg resize: (1080, 1920) 1392055036 -0.7216595849309682 treat image : temp/1771483829_2048797_1392055001_27b1973d254ff0833422611dc4594de6.jpg resize: (1080, 1920) 1392055001 0.705013295380169 treat image : temp/1771483829_2048797_1392054968_7ef6331d691fe9d822bab60384147fe1.jpg resize: (1080, 1920) 1392054968 0.48299471555410756 treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae.jpg resize: (1080, 1920) 1392054931 0.9258250783695873 treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea.jpg resize: (1080, 1920) 1392054892 0.7851262123665841 treat image : temp/1771483829_2048797_1392056061_8783fece12d2c9bf46428c806eebfc2d_rle_crop_4136681345_0.png resize: (200, 110) 1408896310 -1.4897403108213114 treat image : temp/1771483829_2048797_1392055920_4d1f775121e30f30517979ff36ee093c_rle_crop_4136681347_0.png resize: (76, 139) 1408896311 2.1509957846057937 treat image : temp/1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681349_0.png resize: (110, 140) 1408896312 -0.2173138078526436 treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681354_0.png resize: (102, 112) 1408896313 1.56849160934264 treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681359_0.png resize: (157, 86) 1408896314 -1.4098457205169443 treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681361_0.png resize: (121, 92) 1408896315 -0.24994320043065862 treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681362_0.png resize: (66, 113) 1408896316 -0.9161990611926086 treat image : temp/1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681365_0.png resize: (125, 85) 1408896317 0.00486945670446861 treat image : temp/1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681366_0.png resize: (154, 220) 1408896318 -1.6252039419434805 treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681368_0.png resize: (209, 166) 1408896319 -1.4455049085640201 treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681369_0.png resize: (63, 61) 1408896320 0.6125425808714529 treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681370_0.png resize: (69, 53) 1408896321 6.0687670978040575 treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681374_0.png resize: (91, 75) 1408896322 0.42811709746304716 treat image : temp/1771483829_2048797_1392055337_f28c4b54b4ae8b18cd8ddc19f77e500a_rle_crop_4136681375_0.png resize: (65, 114) 1408896324 0.9583832791250964 treat image : temp/1771483829_2048797_1392055337_f28c4b54b4ae8b18cd8ddc19f77e500a_rle_crop_4136681376_0.png resize: (82, 76) 1408896325 0.33726836033930396 treat image : temp/1771483829_2048797_1392055301_9bbd1fb70397de8757e43c3185b72ef8_rle_crop_4136681377_0.png resize: (213, 289) 1408896326 -1.303737590641456 treat image : temp/1771483829_2048797_1392055264_c277ff19775588b955f99d5b21844541_rle_crop_4136681378_0.png resize: (132, 167) 1408896327 -0.9085666020495936 treat image : temp/1771483829_2048797_1392055264_c277ff19775588b955f99d5b21844541_rle_crop_4136681379_0.png resize: (96, 93) 1408896328 0.47875828620984767 treat image : temp/1771483829_2048797_1392055070_f1513d223be1634234c5c62777a7c8ac_rle_crop_4136681380_0.png resize: (145, 105) 1408896329 -0.7457474352126364 treat image : temp/1771483829_2048797_1392055070_f1513d223be1634234c5c62777a7c8ac_rle_crop_4136681381_0.png resize: (134, 125) 1408896330 -1.7155326243757398 treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681382_0.png resize: (70, 74) 1408896331 0.4510073327337915 treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681386_0.png resize: (131, 105) 1408896332 -1.399578145726662 treat image : temp/1771483829_2048797_1392054968_7ef6331d691fe9d822bab60384147fe1_rle_crop_4136681389_0.png resize: (142, 109) 1408896333 -1.5560786876660624 treat image : temp/1771483829_2048797_1392054968_7ef6331d691fe9d822bab60384147fe1_rle_crop_4136681390_0.png resize: (94, 93) 1408896334 -1.3399743428619015 treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681392_0.png resize: (126, 91) 1408896335 -2.1610958979221326 treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681397_0.png resize: (93, 85) 1408896336 2.0187133433443556 treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681353_0.png resize: (143, 119) 1408896337 -1.4086008630795757 treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681384_0.png resize: (151, 106) 1408896338 -1.8625316084324395 treat image : temp/1771483829_2048797_1392056061_8783fece12d2c9bf46428c806eebfc2d_rle_crop_4136681346_0.png resize: (134, 141) 1408896382 0.8072618595791939 treat image : temp/1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681348_0.png resize: (49, 109) 1408896384 -0.30040012060612825 treat image : temp/1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681350_0.png resize: (143, 101) 1408896385 -1.3247310265344165 treat image : temp/1771483829_2048797_1392055912_b61ba8c12fc8c6730abcd95f757ee01a_rle_crop_4136681351_0.png resize: (44, 94) 1408896386 4.380317746464443 treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681352_0.png resize: (121, 186) 1408896388 -0.618131972840896 treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681355_0.png resize: (64, 49) 1408896389 -1.777926547051477 treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681356_0.png resize: (159, 86) 1408896390 -0.9222562628518192 treat image : temp/1771483829_2048797_1392055907_36f69acb91553eba83c7bdf78006e5f5_rle_crop_4136681357_0.png resize: (192, 136) 1408896392 -0.27813039610792906 treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681360_0.png resize: (162, 125) 1408896393 -1.6326114049586922 treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681363_0.png resize: (129, 82) 1408896394 -2.202450813822819 treat image : temp/1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681364_0.png resize: (128, 128) 1408896396 -1.3878908035343112 treat image : temp/1771483829_2048797_1392055408_53d90fda6a26e11d112383de3b4c7518_rle_crop_4136681367_0.png resize: (162, 172) 1408896397 -1.5283668912165789 treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681371_0.png resize: (222, 143) 1408896399 -0.8223337499097253 treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681372_0.png resize: (241, 195) 1408896400 -0.9905477542440412 treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681373_0.png resize: (989, 1120) 1408896401 -0.09185869304454906 treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681383_0.png resize: (114, 102) 1408896403 -2.9366361530359044 treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681385_0.png resize: (163, 290) 1408896404 -1.8276241501307802 treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681387_0.png resize: (252, 204) 1408896405 -1.1439948634150898 treat image : temp/1771483829_2048797_1392055001_27b1973d254ff0833422611dc4594de6_rle_crop_4136681388_0.png resize: (181, 108) 1408896407 -1.3429428194718844 treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681391_0.png resize: (230, 141) 1408896408 -1.1162483154656455 treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681393_0.png resize: (233, 130) 1408896410 -1.7126996501433143 treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681394_0.png resize: (214, 176) 1408896411 -1.2843025482101114 treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681395_0.png resize: (113, 80) 1408896412 -1.663786657585212 treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681396_0.png resize: (158, 168) 1408896414 -1.0249960454055957 treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681398_0.png resize: (195, 285) 1408896415 0.33380302591980465 treat image : temp/1771483829_2048797_1392055907_36f69acb91553eba83c7bdf78006e5f5_rle_crop_4136681358_0.png resize: (87, 83) 1408896423 -0.17808978776843193 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 73 time used for this insertion : 0.017087221145629883 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 73 time used for this insertion : 0.022425174713134766 save missing photos in datou_result : time spend for datou_step_exec : 15.158425092697144 time spend to save output : 0.04510688781738281 total time spend for step 6 : 15.203531980514526 step7:brightness Thu Feb 19 07:52:11 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1771483829_2048797_1392056061_8783fece12d2c9bf46428c806eebfc2d.jpg treat image : temp/1771483829_2048797_1392055920_4d1f775121e30f30517979ff36ee093c.jpg treat image : temp/1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1.jpg treat image : temp/1771483829_2048797_1392055912_b61ba8c12fc8c6730abcd95f757ee01a.jpg treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531.jpg treat image : temp/1771483829_2048797_1392055907_36f69acb91553eba83c7bdf78006e5f5.jpg treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79.jpg treat image : temp/1771483829_2048797_1392055446_42ca403780c522d327793519a93badab.jpg treat image : temp/1771483829_2048797_1392055408_53d90fda6a26e11d112383de3b4c7518.jpg treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389.jpg treat image : temp/1771483829_2048797_1392055337_f28c4b54b4ae8b18cd8ddc19f77e500a.jpg treat image : temp/1771483829_2048797_1392055301_9bbd1fb70397de8757e43c3185b72ef8.jpg treat image : temp/1771483829_2048797_1392055264_c277ff19775588b955f99d5b21844541.jpg treat image : temp/1771483829_2048797_1392055070_f1513d223be1634234c5c62777a7c8ac.jpg treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5.jpg treat image : temp/1771483829_2048797_1392055001_27b1973d254ff0833422611dc4594de6.jpg treat image : temp/1771483829_2048797_1392054968_7ef6331d691fe9d822bab60384147fe1.jpg treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae.jpg treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea.jpg treat image : temp/1771483829_2048797_1392056061_8783fece12d2c9bf46428c806eebfc2d_rle_crop_4136681345_0.png treat image : temp/1771483829_2048797_1392055920_4d1f775121e30f30517979ff36ee093c_rle_crop_4136681347_0.png treat image : temp/1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681349_0.png treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681354_0.png treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681359_0.png treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681361_0.png treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681362_0.png treat image : temp/1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681365_0.png treat image : temp/1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681366_0.png treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681368_0.png treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681369_0.png treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681370_0.png treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681374_0.png treat image : temp/1771483829_2048797_1392055337_f28c4b54b4ae8b18cd8ddc19f77e500a_rle_crop_4136681375_0.png treat image : temp/1771483829_2048797_1392055337_f28c4b54b4ae8b18cd8ddc19f77e500a_rle_crop_4136681376_0.png treat image : temp/1771483829_2048797_1392055301_9bbd1fb70397de8757e43c3185b72ef8_rle_crop_4136681377_0.png treat image : temp/1771483829_2048797_1392055264_c277ff19775588b955f99d5b21844541_rle_crop_4136681378_0.png treat image : temp/1771483829_2048797_1392055264_c277ff19775588b955f99d5b21844541_rle_crop_4136681379_0.png treat image : temp/1771483829_2048797_1392055070_f1513d223be1634234c5c62777a7c8ac_rle_crop_4136681380_0.png treat image : temp/1771483829_2048797_1392055070_f1513d223be1634234c5c62777a7c8ac_rle_crop_4136681381_0.png treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681382_0.png treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681386_0.png treat image : temp/1771483829_2048797_1392054968_7ef6331d691fe9d822bab60384147fe1_rle_crop_4136681389_0.png treat image : temp/1771483829_2048797_1392054968_7ef6331d691fe9d822bab60384147fe1_rle_crop_4136681390_0.png treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681392_0.png treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681397_0.png treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681353_0.png treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681384_0.png treat image : temp/1771483829_2048797_1392056061_8783fece12d2c9bf46428c806eebfc2d_rle_crop_4136681346_0.png treat image : temp/1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681348_0.png treat image : temp/1771483829_2048797_1392055916_9bba73e73d8c5746cae68ee13bb7c6b1_rle_crop_4136681350_0.png treat image : temp/1771483829_2048797_1392055912_b61ba8c12fc8c6730abcd95f757ee01a_rle_crop_4136681351_0.png treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681352_0.png treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681355_0.png treat image : temp/1771483829_2048797_1392055910_402fff974866d46e6318582ae4729531_rle_crop_4136681356_0.png treat image : temp/1771483829_2048797_1392055907_36f69acb91553eba83c7bdf78006e5f5_rle_crop_4136681357_0.png treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681360_0.png treat image : temp/1771483829_2048797_1392055903_85951669c57d6ef6c8a7f9d2046d7e79_rle_crop_4136681363_0.png treat image : temp/1771483829_2048797_1392055446_42ca403780c522d327793519a93badab_rle_crop_4136681364_0.png treat image : temp/1771483829_2048797_1392055408_53d90fda6a26e11d112383de3b4c7518_rle_crop_4136681367_0.png treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681371_0.png treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681372_0.png treat image : temp/1771483829_2048797_1392055372_00a48de6fb1504144d569ecac4aed389_rle_crop_4136681373_0.png treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681383_0.png treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681385_0.png treat image : temp/1771483829_2048797_1392055036_1de855a9f3b2d4839eef13439732c3a5_rle_crop_4136681387_0.png treat image : temp/1771483829_2048797_1392055001_27b1973d254ff0833422611dc4594de6_rle_crop_4136681388_0.png treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681391_0.png treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681393_0.png treat image : temp/1771483829_2048797_1392054931_cc955e05131f9c1f106e91af56b1d8ae_rle_crop_4136681394_0.png treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681395_0.png treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681396_0.png treat image : temp/1771483829_2048797_1392054892_b321cc1e9149214ecd4e2b56495186ea_rle_crop_4136681398_0.png treat image : temp/1771483829_2048797_1392055907_36f69acb91553eba83c7bdf78006e5f5_rle_crop_4136681358_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 73 time used for this insertion : 0.018009662628173828 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 73 time used for this insertion : 0.020747900009155273 save missing photos in datou_result : time spend for datou_step_exec : 4.142767667770386 time spend to save output : 0.044684410095214844 total time spend for step 7 : 4.187452077865601 step8:velours_tree Thu Feb 19 07:52:15 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09880900382995605 time spend to save output : 3.9577484130859375e-05 total time spend for step 8 : 0.09884858131408691 step9:send_mail_cod Thu Feb 19 07:52:15 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30454598_19-02-2026_07_52_15.pdf 30457427 change filename to text .change filename to text .imagette304574271771483935 30457428 change filename to text .imagette304574281771483935 30457429 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette304574291771483935 30457430 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette304574301771483937 30457432 imagette304574321771483938 30457433 imagette304574331771483938 30457434 change filename to text .change filename to text .imagette304574341771483938 30457435 imagette304574351771483939 30457436 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette304574361771483939 30457437 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette304574371771483939 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30454598 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30457427,30457428,30457429,30457430,30457431,30457432,30457433,30457434,30457435,30457436,30457437?tags=pet_fonce,pehd,papier,pet_clair,environnement,flou,background,metal,mal_croppe,autre,carton your option no_mail is active, we will not send the real mail to your client args[1392056061] : ((1392056061, 1.136669740242657, 492688767), (1392056061, 0.9313566601604623, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055920] : ((1392055920, 0.31801467320147625, 492688767), (1392055920, 0.8735717255483086, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055916] : ((1392055916, 0.48092556083981863, 492688767), (1392055916, 0.8172761203504456, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055912] : ((1392055912, -0.03584633798557356, 492688767), (1392055912, 0.7898559136443384, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055910] : ((1392055910, 0.7221898399787566, 492688767), (1392055910, 0.8894767157587723, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055907] : ((1392055907, 0.3052892837475883, 492688767), (1392055907, 0.42301470568397054, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055903] : ((1392055903, 0.7269978283875363, 492688767), (1392055903, 0.5256882044295366, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055446] : ((1392055446, 0.09835135430802967, 492688767), (1392055446, 0.6717228374195936, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055408] : ((1392055408, 0.45518867977618815, 492688767), (1392055408, 0.721867297072413, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055372] : ((1392055372, 0.139509095529497, 492688767), (1392055372, 0.6820552471934144, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055337] : ((1392055337, 0.9240076312974841, 492688767), (1392055337, 0.6293628303162732, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055301] : ((1392055301, 0.3893779733377987, 492688767), (1392055301, 0.7791108599156387, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055264] : ((1392055264, 0.9890622889837195, 492688767), (1392055264, 0.6858252305334785, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055070] : ((1392055070, 0.3498557726996632, 492688767), (1392055070, 0.592330042850471, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055036] : ((1392055036, -0.7216595849309682, 492688767), (1392055036, 0.5390414477079004, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392055001] : ((1392055001, 0.705013295380169, 492688767), (1392055001, 0.3400727759697085, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392054968] : ((1392054968, 0.48299471555410756, 492688767), (1392054968, 0.6747851263070033, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392054931] : ((1392054931, 0.9258250783695873, 492688767), (1392054931, 0.6248351091753213, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com args[1392054892] : ((1392054892, 0.7851262123665841, 492688767), (1392054892, 0.6113818722565267, 2107752395), '0.06875782230853733') We are sending mail with results at report@fotonower.com refus_total : 0.06875782230853733 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30454598 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30454598_19-02-2026_07_52_15.pdf results_Auto_P30454598_19-02-2026_07_52_15.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30454598_19-02-2026_07_52_15.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30454598','results_Auto_P30454598_19-02-2026_07_52_15.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30454598_19-02-2026_07_52_15.pdf','pdf','','0.39','0.06875782230853733') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1392056061, 1392055920, 1392055916, 1392055912, 1392055910, 1392055907, 1392055903, 1392055446, 1392055408, 1392055372, 1392055337, 1392055301, 1392055264, 1392055070, 1392055036, 1392055001, 1392054968, 1392054931, 1392054892] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392056061', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055920', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055916', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055912', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055910', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055907', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055903', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055446', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055408', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055372', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055337', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055301', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055264', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055070', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055036', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055001', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054968', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054931', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054892', None, None, None, None, None, '4348464') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.01674056053161621 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.77711033821106 time spend to save output : 0.017047643661499023 total time spend for step 9 : 6.794157981872559 step10:split_time_score Thu Feb 19 07:52:22 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 59),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03112025 30454598 Nombre de photos uploadées : 59 / 23040 (0%) 03112025 30454598 Nombre de photos taguées (types de déchets): 0 / 59 (0%) 03112025 30454598 Nombre de photos taguées (volume) : 0 / 59 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ??????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.002663850784301758 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23857498168945312 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30454538 order by id desc limit 1 Qualite : 0.26789930555555563 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28089591_03-11-2025_10_56_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28089591 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28089591 AND mptpi.`type`=3594 To do Qualite : 0.1863057966820988 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28089594_03-11-2025_10_51_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28089594 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28089594 AND mptpi.`type`=3594 To do Qualite : 0.11127062971536356 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28089596_03-11-2025_10_42_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28089596 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28089596 AND mptpi.`type`=3594 To do Qualite : 0.0840693721064815 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30454598_19-02-2026_07_52_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30454598 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30454598 AND mptpi.`type`=3594 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30454602_19-02-2026_06_41_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30454602 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30454602 AND mptpi.`type`=3594 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30454607_19-02-2026_06_31_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30454607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30454607 AND mptpi.`type`=3594 To do Qualite : 0.02306418788580247 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30454654_19-02-2026_06_22_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30454654 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30454654 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03112025': {'nb_upload': 59, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1392056061, 1392055920, 1392055916, 1392055912, 1392055910, 1392055907, 1392055903, 1392055446, 1392055408, 1392055372, 1392055337, 1392055301, 1392055264, 1392055070, 1392055036, 1392055001, 1392054968, 1392054931, 1392054892] Looping around the photos to save general results len do output : 1 /30454598Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392056061', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055920', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055916', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055912', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055910', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055907', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055903', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055446', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055408', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055372', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055337', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055301', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055264', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055070', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055036', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392055001', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054968', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054931', None, None, None, None, None, '4348464') ('3318', None, None, None, None, None, None, None, '4348464') ('3318', None, '1392054892', None, None, None, None, None, '4348464') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.016937732696533203 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.6497509479522705 time spend to save output : 0.017191410064697266 total time spend for step 10 : 2.6669423580169678 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 19 set_done_treatment 47.26user 25.47system 2:00.04elapsed 60%CPU (0avgtext+0avgdata 2951732maxresident)k 5312inputs+24072outputs (47major+2106670minor)pagefaults 0swaps