python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3683824 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4277538'] with mtr_portfolio_ids : ['29731774'] and first list_photo_ids : [] new path : /proc/3683824/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 14 ; length of list_pids : 14 ; length of list_args : 14 time to download the photos : 2.956667900085449 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Dec 26 22:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10826 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-26 22:10:34.149611: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-26 22:10:34.178415: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-26 22:10:34.180663: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0de4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-26 22:10:34.180725: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-26 22:10:34.184745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-26 22:10:34.416467: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x43bace80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-26 22:10:34.416513: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-26 22:10:34.417943: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-26 22:10:34.418362: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-26 22:10:34.421633: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-26 22:10:34.424419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-26 22:10:34.424827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-26 22:10:34.427619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-26 22:10:34.428991: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-26 22:10:34.433732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-26 22:10:34.435250: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-26 22:10:34.435325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-26 22:10:34.436111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-26 22:10:34.436126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-26 22:10:34.436134: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-26 22:10:34.437412: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-26 22:10:34.702853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-26 22:10:34.702987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-26 22:10:34.703011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-26 22:10:34.703034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-26 22:10:34.703055: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-26 22:10:34.703075: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-26 22:10:34.703095: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-26 22:10:34.703116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-26 22:10:34.704671: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-26 22:10:34.706041: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-26 22:10:34.706077: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-26 22:10:34.706096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-26 22:10:34.706114: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-26 22:10:34.706130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-26 22:10:34.706147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-26 22:10:34.706164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-26 22:10:34.706181: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-26 22:10:34.707683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-26 22:10:34.707717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-26 22:10:34.707725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-26 22:10:34.707732: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-26 22:10:34.708932: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-26 22:10:46.597250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-26 22:10:46.772428: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 3684429 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5537 tf kernel not reseted sub process len(results) : 14 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 14 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10826 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1614, 1968, 1974, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.006523847579956055 nb_pixel_total : 241716 time to create 1 rle with new method : 0.014825820922851562 length of segment : 395 DEBUG bbox = [1218, 2094, 1494, 2322] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007944107055664062 nb_pixel_total : 40122 time to create 1 rle with old method : 0.04994320869445801 length of segment : 273 DEBUG bbox = [636, 1836, 918, 2100] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000720977783203125 nb_pixel_total : 31576 time to create 1 rle with old method : 0.03955268859863281 length of segment : 235 DEBUG bbox = [462, 2034, 978, 2448] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021483898162841797 nb_pixel_total : 115726 time to create 1 rle with old method : 0.1465601921081543 length of segment : 451 DEBUG bbox = [186, 2502, 462, 2688] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000965118408203125 nb_pixel_total : 34331 time to create 1 rle with old method : 0.05132484436035156 length of segment : 257 DEBUG bbox = [1110, 528, 1266, 918] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009405612945556641 nb_pixel_total : 47876 time to create 1 rle with old method : 0.0682833194732666 length of segment : 142 DEBUG bbox = [1770, 606, 2160, 966] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018603801727294922 nb_pixel_total : 77259 time to create 1 rle with old method : 0.08902835845947266 length of segment : 442 DEBUG bbox = [1284, 1890, 1566, 2094] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004992485046386719 nb_pixel_total : 17094 time to create 1 rle with old method : 0.018776893615722656 length of segment : 231 DEBUG bbox = [1086, 2250, 1236, 2394] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00022912025451660156 nb_pixel_total : 10399 time to create 1 rle with old method : 0.013693094253540039 length of segment : 117 DEBUG bbox = [60, 3096, 408, 3426] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001096963882446289 nb_pixel_total : 61211 time to create 1 rle with old method : 0.06949758529663086 length of segment : 290 DEBUG bbox = [546, 1140, 870, 1506] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010564327239990234 nb_pixel_total : 71559 time to create 1 rle with old method : 0.08385372161865234 length of segment : 304 DEBUG bbox = [18, 3006, 162, 3186] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00037980079650878906 nb_pixel_total : 17226 time to create 1 rle with old method : 0.0344698429107666 length of segment : 141 DEBUG bbox = [120, 2094, 474, 2628] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014660358428955078 nb_pixel_total : 88790 time to create 1 rle with old method : 0.10289740562438965 length of segment : 284 DEBUG bbox = [618, 1722, 804, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006256103515625 nb_pixel_total : 33703 time to create 1 rle with old method : 0.04004216194152832 length of segment : 162 DEBUG bbox = [1218, 1254, 1404, 1500] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003879070281982422 nb_pixel_total : 27836 time to create 1 rle with old method : 0.03203582763671875 length of segment : 185 DEBUG bbox = [6, 438, 198, 576] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002841949462890625 nb_pixel_total : 15655 time to create 1 rle with old method : 0.017594099044799805 length of segment : 191 DEBUG bbox = [12, 2682, 132, 2910] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002956390380859375 nb_pixel_total : 20678 time to create 1 rle with old method : 0.02347564697265625 length of segment : 111 DEBUG bbox = [1806, 1728, 1986, 1986] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00037479400634765625 nb_pixel_total : 24947 time to create 1 rle with old method : 0.027976274490356445 length of segment : 169 DEBUG bbox = [1740, 2658, 2016, 2916] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005640983581542969 nb_pixel_total : 43152 time to create 1 rle with old method : 0.0458064079284668 length of segment : 265 DEBUG bbox = [192, 3444, 450, 3648] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004687309265136719 nb_pixel_total : 33895 time to create 1 rle with old method : 0.035451412200927734 length of segment : 229 DEBUG bbox = [420, 2826, 648, 3390] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008776187896728516 nb_pixel_total : 69105 time to create 1 rle with old method : 0.07848739624023438 length of segment : 225 DEBUG bbox = [1890, 1710, 2136, 1842] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00035500526428222656 nb_pixel_total : 27505 time to create 1 rle with old method : 0.029783964157104492 length of segment : 246 DEBUG bbox = [1716, 1830, 1968, 2010] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003483295440673828 nb_pixel_total : 22469 time to create 1 rle with old method : 0.02428460121154785 length of segment : 228 DEBUG bbox = [204, 1494, 444, 1926] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007431507110595703 nb_pixel_total : 53961 time to create 1 rle with old method : 0.0586085319519043 length of segment : 231 DEBUG bbox = [456, 1488, 822, 1848] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00186920166015625 nb_pixel_total : 80190 time to create 1 rle with old method : 0.08603167533874512 length of segment : 400 DEBUG bbox = [366, 252, 780, 534] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017094612121582031 nb_pixel_total : 61307 time to create 1 rle with old method : 0.06500077247619629 length of segment : 446 DEBUG bbox = [1620, 2172, 1782, 2298] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046896934509277344 nb_pixel_total : 12607 time to create 1 rle with old method : 0.014526844024658203 length of segment : 145 DEBUG bbox = [1902, 2712, 2076, 2970] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007445812225341797 nb_pixel_total : 19154 time to create 1 rle with old method : 0.0217130184173584 length of segment : 173 DEBUG bbox = [36, 168, 666, 462] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002793550491333008 nb_pixel_total : 92606 time to create 1 rle with old method : 0.09949445724487305 length of segment : 647 DEBUG bbox = [138, 1668, 858, 2208] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.006891965866088867 nb_pixel_total : 220337 time to create 1 rle with new method : 0.012047052383422852 length of segment : 670 DEBUG bbox = [1674, 1440, 1944, 1668] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001028299331665039 nb_pixel_total : 32601 time to create 1 rle with old method : 0.035318613052368164 length of segment : 233 DEBUG bbox = [276, 3216, 432, 3420] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005602836608886719 nb_pixel_total : 20872 time to create 1 rle with old method : 0.02292466163635254 length of segment : 155 DEBUG bbox = [66, 2484, 306, 2634] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 19525 time to create 1 rle with old method : 0.0215301513671875 length of segment : 228 DEBUG bbox = [54, 3102, 534, 3480] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021991729736328125 nb_pixel_total : 106603 time to create 1 rle with old method : 0.11444687843322754 length of segment : 568 DEBUG bbox = [18, 1740, 144, 1854] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003097057342529297 nb_pixel_total : 8608 time to create 1 rle with old method : 0.00948190689086914 length of segment : 104 DEBUG bbox = [30, 2454, 144, 2616] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00020599365234375 nb_pixel_total : 7131 time to create 1 rle with old method : 0.008185386657714844 length of segment : 88 DEBUG bbox = [78, 492, 276, 672] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006406307220458984 nb_pixel_total : 24974 time to create 1 rle with old method : 0.028350114822387695 length of segment : 179 DEBUG bbox = [54, 1152, 264, 1260] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005037784576416016 nb_pixel_total : 14133 time to create 1 rle with old method : 0.01586461067199707 length of segment : 172 DEBUG bbox = [78, 18, 354, 192] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009398460388183594 nb_pixel_total : 39110 time to create 1 rle with old method : 0.04553055763244629 length of segment : 256 DEBUG bbox = [510, 942, 768, 1182] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000911712646484375 nb_pixel_total : 30061 time to create 1 rle with old method : 0.03414726257324219 length of segment : 256 DEBUG bbox = [60, 978, 462, 1236] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012481212615966797 nb_pixel_total : 44004 time to create 1 rle with old method : 0.04849386215209961 length of segment : 475 DEBUG bbox = [750, 2340, 1284, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034208297729492188 nb_pixel_total : 153105 time to create 1 rle with new method : 0.008801937103271484 length of segment : 493 DEBUG bbox = [84, 984, 396, 1326] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015745162963867188 nb_pixel_total : 63230 time to create 1 rle with old method : 0.07207417488098145 length of segment : 311 DEBUG bbox = [1200, 1866, 1518, 2052] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009632110595703125 nb_pixel_total : 35593 time to create 1 rle with old method : 0.03976631164550781 length of segment : 292 DEBUG bbox = [1338, 1524, 1578, 1692] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006847381591796875 nb_pixel_total : 24272 time to create 1 rle with old method : 0.026007652282714844 length of segment : 227 DEBUG bbox = [36, 3192, 354, 3420] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010921955108642578 nb_pixel_total : 35043 time to create 1 rle with old method : 0.03811764717102051 length of segment : 294 DEBUG bbox = [714, 270, 996, 468] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007936954498291016 nb_pixel_total : 26017 time to create 1 rle with old method : 0.02842426300048828 length of segment : 252 DEBUG bbox = [1800, 2310, 2040, 2484] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006418228149414062 nb_pixel_total : 16771 time to create 1 rle with old method : 0.018605709075927734 length of segment : 255 DEBUG bbox = [864, 1284, 1410, 1632] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0028252601623535156 nb_pixel_total : 135652 time to create 1 rle with old method : 0.15792179107666016 length of segment : 510 DEBUG bbox = [234, 2094, 576, 2388] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019235610961914062 nb_pixel_total : 52604 time to create 1 rle with old method : 0.05759596824645996 length of segment : 320 DEBUG bbox = [954, 1800, 1290, 2508] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0037589073181152344 nb_pixel_total : 151109 time to create 1 rle with new method : 0.0069980621337890625 length of segment : 323 DEBUG bbox = [144, 282, 330, 468] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007734298706054688 nb_pixel_total : 21319 time to create 1 rle with old method : 0.02429342269897461 length of segment : 150 DEBUG bbox = [1614, 2466, 1890, 2700] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012183189392089844 nb_pixel_total : 45050 time to create 1 rle with old method : 0.05530405044555664 length of segment : 305 DEBUG bbox = [1542, 2202, 1656, 2322] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000347137451171875 nb_pixel_total : 6363 time to create 1 rle with old method : 0.007325887680053711 length of segment : 106 DEBUG bbox = [1596, 1602, 1794, 1956] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000972747802734375 nb_pixel_total : 21953 time to create 1 rle with old method : 0.025028228759765625 length of segment : 167 DEBUG bbox = [1554, 2076, 1668, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031256675720214844 nb_pixel_total : 13338 time to create 1 rle with old method : 0.015122652053833008 length of segment : 114 DEBUG bbox = [264, 2658, 492, 2754] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000598907470703125 nb_pixel_total : 19270 time to create 1 rle with old method : 0.021503210067749023 length of segment : 227 DEBUG bbox = [1230, 1404, 1578, 1764] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020074844360351562 nb_pixel_total : 78953 time to create 1 rle with old method : 0.08653688430786133 length of segment : 333 DEBUG bbox = [936, 2850, 1326, 3258] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002333402633666992 nb_pixel_total : 87710 time to create 1 rle with old method : 0.09486937522888184 length of segment : 386 DEBUG bbox = [678, 2778, 852, 2952] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006079673767089844 nb_pixel_total : 20067 time to create 1 rle with old method : 0.02124953269958496 length of segment : 168 DEBUG bbox = [222, 2802, 1002, 3270] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004414796829223633 nb_pixel_total : 160309 time to create 1 rle with new method : 0.010816812515258789 length of segment : 725 DEBUG bbox = [450, 2406, 666, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006246566772460938 nb_pixel_total : 15483 time to create 1 rle with old method : 0.017633676528930664 length of segment : 164 DEBUG bbox = [0, 1134, 876, 1998] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0125885009765625 nb_pixel_total : 434497 time to create 1 rle with new method : 0.03998827934265137 length of segment : 760 DEBUG bbox = [612, 1938, 1014, 2238] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013842582702636719 nb_pixel_total : 30811 time to create 1 rle with old method : 0.035622358322143555 length of segment : 392 DEBUG bbox = [738, 456, 1074, 732] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016891956329345703 nb_pixel_total : 55160 time to create 1 rle with old method : 0.06736159324645996 length of segment : 333 DEBUG bbox = [6, 900, 126, 1116] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003972053527832031 nb_pixel_total : 16328 time to create 1 rle with old method : 0.01941657066345215 length of segment : 114 DEBUG bbox = [282, 522, 606, 714] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016274452209472656 nb_pixel_total : 31121 time to create 1 rle with old method : 0.05255532264709473 length of segment : 362 DEBUG bbox = [1590, 1812, 1860, 2040] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000823974609375 nb_pixel_total : 39658 time to create 1 rle with old method : 0.04267263412475586 length of segment : 319 DEBUG bbox = [6, 2118, 132, 2358] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 21716 time to create 1 rle with old method : 0.024204730987548828 length of segment : 113 DEBUG bbox = [1968, 1692, 2154, 2040] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007114410400390625 nb_pixel_total : 42830 time to create 1 rle with old method : 0.04647469520568848 length of segment : 186 DEBUG bbox = [12, 1152, 174, 1350] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004227161407470703 nb_pixel_total : 22556 time to create 1 rle with old method : 0.024584054946899414 length of segment : 159 DEBUG bbox = [846, 2472, 960, 2580] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002257823944091797 nb_pixel_total : 8348 time to create 1 rle with old method : 0.00957036018371582 length of segment : 99 DEBUG bbox = [1698, 624, 2052, 924] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 50423 time to create 1 rle with old method : 0.05451488494873047 length of segment : 375 DEBUG bbox = [1146, 2760, 1278, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00032806396484375 nb_pixel_total : 10310 time to create 1 rle with old method : 0.011628866195678711 length of segment : 119 DEBUG bbox = [1806, 2628, 1920, 2730] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00020360946655273438 nb_pixel_total : 7115 time to create 1 rle with old method : 0.008052587509155273 length of segment : 101 DEBUG bbox = [600, 330, 780, 468] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040268898010253906 nb_pixel_total : 13998 time to create 1 rle with old method : 0.015537261962890625 length of segment : 152 DEBUG bbox = [1866, 2790, 2136, 2940] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006074905395507812 nb_pixel_total : 26510 time to create 1 rle with old method : 0.029051780700683594 length of segment : 248 DEBUG bbox = [1560, 1302, 1788, 1608] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008738040924072266 nb_pixel_total : 36711 time to create 1 rle with old method : 0.03992652893066406 length of segment : 269 DEBUG bbox = [894, 1932, 1284, 2196] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012242794036865234 nb_pixel_total : 43103 time to create 1 rle with old method : 0.04785513877868652 length of segment : 456 DEBUG bbox = [30, 330, 360, 906] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022215843200683594 nb_pixel_total : 81673 time to create 1 rle with old method : 0.08956122398376465 length of segment : 373 DEBUG bbox = [114, 1782, 414, 2052] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007624626159667969 nb_pixel_total : 32046 time to create 1 rle with old method : 0.03563570976257324 length of segment : 296 time spent for convertir_results : 6.8275134563446045 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 81 chid ids of type : 3594 Number RLEs to save : 22347 save missing photos in datou_result : time spend for datou_step_exec : 72.31617856025696 time spend to save output : 1.4589147567749023 total time spend for step 1 : 73.77509331703186 step2:crop_condition Fri Dec 26 22:11:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 14 ! batch 1 Loaded 81 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3736932 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766783513_3683824 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334222_0.png', 0, 226, 263, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334223_0.png', 0, 241, 224, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334224_0.png', 0, 390, 451, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334226_0.png', 0, 381, 139, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334228_0.png', 0, 193, 215, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334231_0.png', 0, 353, 280, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334234_0.png', 0, 370, 162, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334235_0.png', 0, 235, 185, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334236_0.png', 0, 138, 190, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334238_0.png', 0, 245, 169, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334239_0.png', 0, 244, 265, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334242_0.png', 0, 118, 246, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334243_0.png', 0, 180, 227, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334248_0.png', 0, 230, 152, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334260_0.png', 0, 200, 244, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334264_0.png', 0, 167, 266, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334265_0.png', 0, 155, 225, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334268_0.png', 0, 160, 228, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334270_0.png', 0, 265, 307, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334271_0.png', 0, 669, 308, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334273_0.png', 0, 219, 253, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334275_0.png', 0, 325, 166, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334277_0.png', 0, 96, 226, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334278_0.png', 0, 296, 332, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334279_0.png', 0, 358, 368, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334282_0.png', 0, 111, 164, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334284_0.png', 0, 242, 388, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334287_0.png', 0, 190, 309, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334288_0.png', 0, 215, 266, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334290_0.png', 0, 334, 185, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783519), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334294_0.png', 0, 114, 114, 0, 1766783519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 31 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.231396913528442 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766783525_3683824 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783526), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334233_0.png', 0, 493, 235, 0, 1766783526,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783526), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334262_0.png', 0, 514, 493, 0, 1766783526,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783526), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334266_0.png', 0, 200, 294, 0, 1766783526,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783526), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334267_0.png', 0, 188, 251, 0, 1766783526,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783526), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334281_0.png', 0, 391, 709, 0, 1766783526,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783526), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334298_0.png', 0, 275, 204, 0, 1766783526,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9940416812896729 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766783529_3683824 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783530), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334229_0.png', 0, 114, 117, 0, 1766783530,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783530), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334252_0.png', 0, 166, 155, 0, 1766783530,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783530), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334274_0.png', 0, 86, 102, 0, 1766783530,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783530), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334276_0.png', 0, 174, 105, 0, 1766783530,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783530), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334295_0.png', 0, 90, 100, 0, 1766783530,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783530), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334296_0.png', 0, 120, 152, 0, 1766783530,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9815893173217773 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766783542_3683824 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334221_0.png', 0, 888, 347, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334225_0.png', 0, 165, 257, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334227_0.png', 0, 324, 342, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334230_0.png', 0, 318, 289, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334232_0.png', 0, 164, 138, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334237_0.png', 0, 219, 108, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334240_0.png', 0, 201, 229, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334241_0.png', 0, 520, 192, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334244_0.png', 0, 429, 202, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334245_0.png', 0, 350, 356, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334246_0.png', 0, 258, 406, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334249_0.png', 0, 251, 619, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334250_0.png', 0, 507, 670, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334251_0.png', 0, 183, 223, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334253_0.png', 0, 130, 227, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334254_0.png', 0, 372, 426, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334255_0.png', 0, 101, 102, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334256_0.png', 0, 119, 85, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334257_0.png', 0, 176, 177, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334258_0.png', 0, 105, 171, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334259_0.png', 0, 169, 254, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334261_0.png', 0, 207, 341, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334263_0.png', 0, 302, 263, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334272_0.png', 0, 181, 146, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334283_0.png', 0, 773, 759, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334285_0.png', 0, 264, 313, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334286_0.png', 0, 202, 114, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334289_0.png', 0, 239, 109, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334291_0.png', 0, 177, 159, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334293_0.png', 0, 241, 301, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334297_0.png', 0, 132, 247, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334300_0.png', 0, 503, 258, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783548), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170720_60604167d6349027b5bb8b241365ed9a_rle_crop_4082334301_0.png', 0, 216, 296, 0, 1766783548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.196199893951416 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766783553_3683824 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783554), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334247_0.png', 0, 112, 145, 0, 1766783554,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783554), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334269_0.png', 0, 323, 510, 0, 1766783554,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783554), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334280_0.png', 0, 161, 168, 0, 1766783554,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783554), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334292_0.png', 0, 104, 99, 0, 1766783554,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4140422344207764 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766783556_3683824 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766783556), 0.0, 0.0, 14, '', 0, 0, '1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334299_0.png', 0, 220, 373, 0, 1766783556,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7254722118377686 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1401170769, 1401170766, 1401170764, 1401170762, 1401170760, 1401170757, 1401170747, 1401170744, 1401170741, 1401170739, 1401170738, 1401170736, 1401170721, 1401170720] Looping around the photos to save general results len do output : 81 /1401177176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401177283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170769', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170766', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170764', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170762', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170760', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170757', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170747', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170744', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170741', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170739', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170738', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170736', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170721', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170720', None, None, None, None, None, '4277538') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 257 time used for this insertion : 0.03665447235107422 save_final save missing photos in datou_result : time spend for datou_step_exec : 51.612512826919556 time spend to save output : 0.039800167083740234 total time spend for step 2 : 51.652312994003296 step3:rle_unique_nms_with_priority Fri Dec 26 22:12:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 81 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 4.212893486022949 time for calcul the mask position with numpy : 0.535607099533081 nb_pixel_total : 7678301 time to create 1 rle with new method : 0.9996311664581299 time for calcul the mask position with numpy : 0.024865150451660156 nb_pixel_total : 10399 time to create 1 rle with old method : 0.011786222457885742 time for calcul the mask position with numpy : 0.0251617431640625 nb_pixel_total : 17094 time to create 1 rle with old method : 0.02001810073852539 time for calcul the mask position with numpy : 0.024254798889160156 nb_pixel_total : 77259 time to create 1 rle with old method : 0.08259296417236328 time for calcul the mask position with numpy : 0.025217533111572266 nb_pixel_total : 47876 time to create 1 rle with old method : 0.0531008243560791 time for calcul the mask position with numpy : 0.027605772018432617 nb_pixel_total : 34331 time to create 1 rle with old method : 0.03988528251647949 time for calcul the mask position with numpy : 0.03518533706665039 nb_pixel_total : 115726 time to create 1 rle with old method : 0.12237334251403809 time for calcul the mask position with numpy : 0.024692535400390625 nb_pixel_total : 31576 time to create 1 rle with old method : 0.033275604248046875 time for calcul the mask position with numpy : 0.02358102798461914 nb_pixel_total : 40122 time to create 1 rle with old method : 0.04193449020385742 time for calcul the mask position with numpy : 0.025038480758666992 nb_pixel_total : 241716 time to create 1 rle with new method : 0.8570342063903809 create new chi : 3.0988802909851074 time to delete rle : 0.022392749786376953 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7246 TO DO : save crop sub photo not yet done ! save time : 0.4974799156188965 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.177632808685303 time for calcul the mask position with numpy : 0.756843090057373 nb_pixel_total : 7957742 time to create 1 rle with new method : 0.8204081058502197 time for calcul the mask position with numpy : 0.022608518600463867 nb_pixel_total : 20678 time to create 1 rle with old method : 0.02067112922668457 time for calcul the mask position with numpy : 0.02221822738647461 nb_pixel_total : 15655 time to create 1 rle with old method : 0.015853404998779297 time for calcul the mask position with numpy : 0.022663593292236328 nb_pixel_total : 27836 time to create 1 rle with old method : 0.028441429138183594 time for calcul the mask position with numpy : 0.02389240264892578 nb_pixel_total : 33703 time to create 1 rle with old method : 0.03584623336791992 time for calcul the mask position with numpy : 0.025935649871826172 nb_pixel_total : 88790 time to create 1 rle with old method : 0.0962834358215332 time for calcul the mask position with numpy : 0.023588180541992188 nb_pixel_total : 17226 time to create 1 rle with old method : 0.018756628036499023 time for calcul the mask position with numpy : 0.025269031524658203 nb_pixel_total : 71559 time to create 1 rle with old method : 0.07701325416564941 time for calcul the mask position with numpy : 0.02687859535217285 nb_pixel_total : 61211 time to create 1 rle with old method : 0.06556034088134766 create new chi : 2.170206308364868 time to delete rle : 0.0007052421569824219 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5496 TO DO : save crop sub photo not yet done ! save time : 0.3781099319458008 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 1.9817931652069092 time for calcul the mask position with numpy : 0.5562903881072998 nb_pixel_total : 8123301 time to create 1 rle with new method : 0.8468077182769775 time for calcul the mask position with numpy : 0.023012638092041016 nb_pixel_total : 69105 time to create 1 rle with old method : 0.07249331474304199 time for calcul the mask position with numpy : 0.02228260040283203 nb_pixel_total : 33895 time to create 1 rle with old method : 0.034479618072509766 time for calcul the mask position with numpy : 0.022826194763183594 nb_pixel_total : 43152 time to create 1 rle with old method : 0.044069528579711914 time for calcul the mask position with numpy : 0.023357868194580078 nb_pixel_total : 24947 time to create 1 rle with old method : 0.026029109954833984 create new chi : 1.713702917098999 time to delete rle : 0.0005736351013183594 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3936 TO DO : save crop sub photo not yet done ! save time : 0.2876780033111572 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.819973945617676 time for calcul the mask position with numpy : 0.7249979972839355 nb_pixel_total : 8036361 time to create 1 rle with new method : 0.8903508186340332 time for calcul the mask position with numpy : 0.02504253387451172 nb_pixel_total : 12607 time to create 1 rle with old method : 0.014111995697021484 time for calcul the mask position with numpy : 0.026555299758911133 nb_pixel_total : 61307 time to create 1 rle with old method : 0.06663298606872559 time for calcul the mask position with numpy : 0.02330780029296875 nb_pixel_total : 80190 time to create 1 rle with old method : 0.0849766731262207 time for calcul the mask position with numpy : 0.024379968643188477 nb_pixel_total : 53961 time to create 1 rle with old method : 0.056902170181274414 time for calcul the mask position with numpy : 0.022384166717529297 nb_pixel_total : 22469 time to create 1 rle with old method : 0.023825407028198242 time for calcul the mask position with numpy : 0.023416519165039062 nb_pixel_total : 27505 time to create 1 rle with old method : 0.02913808822631836 create new chi : 2.083761215209961 time to delete rle : 0.0007333755493164062 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 5552 TO DO : save crop sub photo not yet done ! save time : 0.3897674083709717 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 3.278743267059326 time for calcul the mask position with numpy : 0.7514653205871582 nb_pixel_total : 7908830 time to create 1 rle with new method : 0.8025290966033936 time for calcul the mask position with numpy : 0.0247039794921875 nb_pixel_total : 20872 time to create 1 rle with old method : 0.022124290466308594 time for calcul the mask position with numpy : 0.023916006088256836 nb_pixel_total : 32601 time to create 1 rle with old method : 0.035562992095947266 time for calcul the mask position with numpy : 0.026787996292114258 nb_pixel_total : 220337 time to create 1 rle with new method : 0.8811407089233398 time for calcul the mask position with numpy : 0.023361682891845703 nb_pixel_total : 92606 time to create 1 rle with old method : 0.09736824035644531 time for calcul the mask position with numpy : 0.024555206298828125 nb_pixel_total : 19154 time to create 1 rle with old method : 0.020958423614501953 create new chi : 2.8003311157226562 time to delete rle : 0.0009737014770507812 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5916 TO DO : save crop sub photo not yet done ! save time : 0.42409443855285645 nb_obj : 5 nb_hashtags : 1 time to prepare the origin masks : 2.047178030014038 time for calcul the mask position with numpy : 0.759350061416626 nb_pixel_total : 8130724 time to create 1 rle with new method : 0.8903162479400635 time for calcul the mask position with numpy : 0.023677349090576172 nb_pixel_total : 24974 time to create 1 rle with old method : 0.027135372161865234 time for calcul the mask position with numpy : 0.028074979782104492 nb_pixel_total : 3966 time to create 1 rle with old method : 0.004358768463134766 time for calcul the mask position with numpy : 0.02646923065185547 nb_pixel_total : 8608 time to create 1 rle with old method : 0.009267330169677734 time for calcul the mask position with numpy : 0.03943467140197754 nb_pixel_total : 106603 time to create 1 rle with old method : 0.11400175094604492 time for calcul the mask position with numpy : 0.024415969848632812 nb_pixel_total : 19525 time to create 1 rle with old method : 0.021484375 create new chi : 2.0106213092803955 time to delete rle : 0.0006191730499267578 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4481 TO DO : save crop sub photo not yet done ! save time : 0.3324286937713623 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.094283103942871 time for calcul the mask position with numpy : 0.744553804397583 nb_pixel_total : 8169160 time to create 1 rle with new method : 0.8065586090087891 time for calcul the mask position with numpy : 0.02505207061767578 nb_pixel_total : 41936 time to create 1 rle with old method : 0.04505276679992676 time for calcul the mask position with numpy : 0.024895191192626953 nb_pixel_total : 30061 time to create 1 rle with old method : 0.03129887580871582 time for calcul the mask position with numpy : 0.02481389045715332 nb_pixel_total : 39110 time to create 1 rle with old method : 0.04186201095581055 time for calcul the mask position with numpy : 0.023650646209716797 nb_pixel_total : 14133 time to create 1 rle with old method : 0.014925003051757812 create new chi : 1.8247933387756348 time to delete rle : 0.0005638599395751953 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 4145 TO DO : save crop sub photo not yet done ! save time : 0.3084888458251953 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.277804136276245 time for calcul the mask position with numpy : 0.5923547744750977 nb_pixel_total : 8018200 time to create 1 rle with new method : 1.0376005172729492 time for calcul the mask position with numpy : 0.025081157684326172 nb_pixel_total : 24272 time to create 1 rle with old method : 0.024847984313964844 time for calcul the mask position with numpy : 0.023743391036987305 nb_pixel_total : 35593 time to create 1 rle with old method : 0.03662562370300293 time for calcul the mask position with numpy : 0.024062395095825195 nb_pixel_total : 63230 time to create 1 rle with old method : 0.08380508422851562 time for calcul the mask position with numpy : 0.02716231346130371 nb_pixel_total : 153105 time to create 1 rle with new method : 0.8203997611999512 create new chi : 2.773606061935425 time to delete rle : 0.0006704330444335938 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4806 TO DO : save crop sub photo not yet done ! save time : 0.3630058765411377 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.1232049465179443 time for calcul the mask position with numpy : 0.9379391670227051 nb_pixel_total : 8080917 time to create 1 rle with new method : 1.23610258102417 time for calcul the mask position with numpy : 0.02722644805908203 nb_pixel_total : 135652 time to create 1 rle with old method : 0.1465604305267334 time for calcul the mask position with numpy : 0.023981094360351562 nb_pixel_total : 16771 time to create 1 rle with old method : 0.018101930618286133 time for calcul the mask position with numpy : 0.02375650405883789 nb_pixel_total : 26017 time to create 1 rle with old method : 0.027239561080932617 time for calcul the mask position with numpy : 0.02330803871154785 nb_pixel_total : 35043 time to create 1 rle with old method : 0.03571343421936035 create new chi : 2.5465621948242188 time to delete rle : 0.0007042884826660156 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4782 TO DO : save crop sub photo not yet done ! save time : 0.35976529121398926 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 5.50566029548645 time for calcul the mask position with numpy : 0.825451135635376 nb_pixel_total : 7777599 time to create 1 rle with new method : 0.6952004432678223 time for calcul the mask position with numpy : 0.023337125778198242 nb_pixel_total : 20067 time to create 1 rle with old method : 0.02105569839477539 time for calcul the mask position with numpy : 0.02544426918029785 nb_pixel_total : 87710 time to create 1 rle with old method : 0.09568071365356445 time for calcul the mask position with numpy : 0.023989439010620117 nb_pixel_total : 78953 time to create 1 rle with old method : 0.08381366729736328 time for calcul the mask position with numpy : 0.02556586265563965 nb_pixel_total : 19270 time to create 1 rle with old method : 0.02107548713684082 time for calcul the mask position with numpy : 0.024687767028808594 nb_pixel_total : 12403 time to create 1 rle with old method : 0.013506412506103516 time for calcul the mask position with numpy : 0.02479267120361328 nb_pixel_total : 21953 time to create 1 rle with old method : 0.023874759674072266 time for calcul the mask position with numpy : 0.026112079620361328 nb_pixel_total : 6363 time to create 1 rle with old method : 0.0069332122802734375 time for calcul the mask position with numpy : 0.027030467987060547 nb_pixel_total : 45050 time to create 1 rle with old method : 0.04853057861328125 time for calcul the mask position with numpy : 0.025122642517089844 nb_pixel_total : 21319 time to create 1 rle with old method : 0.023818016052246094 time for calcul the mask position with numpy : 0.02728438377380371 nb_pixel_total : 151109 time to create 1 rle with new method : 0.8389520645141602 time for calcul the mask position with numpy : 0.024106979370117188 nb_pixel_total : 52604 time to create 1 rle with old method : 0.05399203300476074 create new chi : 3.0993258953094482 time to delete rle : 0.0010466575622558594 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7290 TO DO : save crop sub photo not yet done ! save time : 0.5317003726959229 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.8954617977142334 time for calcul the mask position with numpy : 0.50766921043396 nb_pixel_total : 7550691 time to create 1 rle with new method : 1.157665491104126 time for calcul the mask position with numpy : 0.02466893196105957 nb_pixel_total : 31121 time to create 1 rle with old method : 0.03380012512207031 time for calcul the mask position with numpy : 0.02504754066467285 nb_pixel_total : 16328 time to create 1 rle with old method : 0.017375707626342773 time for calcul the mask position with numpy : 0.024872303009033203 nb_pixel_total : 55160 time to create 1 rle with old method : 0.059049129486083984 time for calcul the mask position with numpy : 0.024654626846313477 nb_pixel_total : 30811 time to create 1 rle with old method : 0.03283214569091797 time for calcul the mask position with numpy : 0.027666330337524414 nb_pixel_total : 434497 time to create 1 rle with new method : 0.7287740707397461 time for calcul the mask position with numpy : 0.026438474655151367 nb_pixel_total : 15483 time to create 1 rle with old method : 0.01660299301147461 time for calcul the mask position with numpy : 0.02520442008972168 nb_pixel_total : 160309 time to create 1 rle with new method : 0.8018906116485596 create new chi : 3.629568099975586 time to delete rle : 0.0011255741119384766 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 7860 TO DO : save crop sub photo not yet done ! save time : 0.5415568351745605 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.7339727878570557 time for calcul the mask position with numpy : 1.2176668643951416 nb_pixel_total : 8108869 time to create 1 rle with new method : 0.8871431350708008 time for calcul the mask position with numpy : 0.025063276290893555 nb_pixel_total : 50423 time to create 1 rle with old method : 0.05278491973876953 time for calcul the mask position with numpy : 0.023867130279541016 nb_pixel_total : 8348 time to create 1 rle with old method : 0.009402990341186523 time for calcul the mask position with numpy : 0.025124549865722656 nb_pixel_total : 22556 time to create 1 rle with old method : 0.024621963500976562 time for calcul the mask position with numpy : 0.027244091033935547 nb_pixel_total : 42830 time to create 1 rle with old method : 0.04745602607727051 time for calcul the mask position with numpy : 0.02613043785095215 nb_pixel_total : 21716 time to create 1 rle with old method : 0.02429032325744629 time for calcul the mask position with numpy : 0.026538848876953125 nb_pixel_total : 39658 time to create 1 rle with old method : 0.0428774356842041 create new chi : 2.503434896469116 time to delete rle : 0.0007116794586181641 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 4662 TO DO : save crop sub photo not yet done ! save time : 0.3612031936645508 nb_obj : 7 nb_hashtags : 5 time to prepare the origin masks : 3.7839272022247314 time for calcul the mask position with numpy : 0.5346765518188477 nb_pixel_total : 8074980 time to create 1 rle with new method : 1.0068190097808838 time for calcul the mask position with numpy : 0.023880720138549805 nb_pixel_total : 81673 time to create 1 rle with old method : 0.08412957191467285 time for calcul the mask position with numpy : 0.02253890037536621 nb_pixel_total : 43103 time to create 1 rle with old method : 0.0441431999206543 time for calcul the mask position with numpy : 0.02245330810546875 nb_pixel_total : 36711 time to create 1 rle with old method : 0.03896045684814453 time for calcul the mask position with numpy : 0.023678302764892578 nb_pixel_total : 26510 time to create 1 rle with old method : 0.026709556579589844 time for calcul the mask position with numpy : 0.02344489097595215 nb_pixel_total : 13998 time to create 1 rle with old method : 0.01419210433959961 time for calcul the mask position with numpy : 0.022832155227661133 nb_pixel_total : 7115 time to create 1 rle with old method : 0.007292985916137695 time for calcul the mask position with numpy : 0.022683382034301758 nb_pixel_total : 10310 time to create 1 rle with old method : 0.010547161102294922 create new chi : 1.969435691833496 time to delete rle : 0.0007901191711425781 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++Number RLEs to save : 5596 TO DO : save crop sub photo not yet done ! save time : 0.4138009548187256 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.8572888374328613 time for calcul the mask position with numpy : 0.5315115451812744 nb_pixel_total : 8262354 time to create 1 rle with new method : 0.7745528221130371 time for calcul the mask position with numpy : 0.022495269775390625 nb_pixel_total : 32046 time to create 1 rle with old method : 0.03245425224304199 create new chi : 1.4021179676055908 time to delete rle : 0.000244140625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2752 TO DO : save crop sub photo not yet done ! save time : 0.22898530960083008 map_output_result : {1401170769: (0.0, 'Should be the crop_list due to order', 0), 1401170766: (0.0, 'Should be the crop_list due to order', 0), 1401170764: (0.0, 'Should be the crop_list due to order', 0), 1401170762: (0.0, 'Should be the crop_list due to order', 0), 1401170760: (0.0, 'Should be the crop_list due to order', 0), 1401170757: (0.0, 'Should be the crop_list due to order', 0), 1401170747: (0.0, 'Should be the crop_list due to order', 0), 1401170744: (0.0, 'Should be the crop_list due to order', 0), 1401170741: (0.0, 'Should be the crop_list due to order', 0), 1401170739: (0.0, 'Should be the crop_list due to order', 0), 1401170738: (0.0, 'Should be the crop_list due to order', 0), 1401170736: (0.0, 'Should be the crop_list due to order', 0), 1401170721: (0.0, 'Should be the crop_list due to order', 0), 1401170720: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1401170769, 1401170766, 1401170764, 1401170762, 1401170760, 1401170757, 1401170747, 1401170744, 1401170741, 1401170739, 1401170738, 1401170736, 1401170721, 1401170720] Looping around the photos to save general results len do output : 14 /1401170769.Didn't retrieve data . /1401170766.Didn't retrieve data . /1401170764.Didn't retrieve data . /1401170762.Didn't retrieve data . /1401170760.Didn't retrieve data . /1401170757.Didn't retrieve data . /1401170747.Didn't retrieve data . /1401170744.Didn't retrieve data . /1401170741.Didn't retrieve data . /1401170739.Didn't retrieve data . /1401170738.Didn't retrieve data . /1401170736.Didn't retrieve data . /1401170721.Didn't retrieve data . /1401170720.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170769', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170766', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170764', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170762', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170760', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170757', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170747', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170744', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170741', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170739', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170738', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170736', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170721', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170720', None, None, None, None, None, '4277538') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.017308712005615234 save_final save missing photos in datou_result : time spend for datou_step_exec : 82.30231666564941 time spend to save output : 0.017871379852294922 total time spend for step 3 : 82.32018804550171 step4:ventilate_hashtags_in_portfolio Fri Dec 26 22:13:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29731774 get user id for portfolio 29731774 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29731774 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','background','carton','autre','metal','papier','pet_clair','environnement','pehd','pet_fonce','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29731774 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','background','carton','autre','metal','papier','pet_clair','environnement','pehd','pet_fonce','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29731774 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','background','carton','autre','metal','papier','pet_clair','environnement','pehd','pet_fonce','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29732008,29732009,29732010,29732011,29732012,29732013,29732014,29732015,29732016,29732017,29732018?tags=mal_croppe,background,carton,autre,metal,papier,pet_clair,environnement,pehd,pet_fonce,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1401170769, 1401170766, 1401170764, 1401170762, 1401170760, 1401170757, 1401170747, 1401170744, 1401170741, 1401170739, 1401170738, 1401170736, 1401170721, 1401170720] Looping around the photos to save general results len do output : 1 /29731774. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170769', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170766', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170764', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170762', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170760', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170757', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170747', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170744', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170741', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170739', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170738', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170736', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170721', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170720', None, None, None, None, None, '4277538') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.017902851104736328 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9570224285125732 time spend to save output : 0.018174171447753906 total time spend for step 4 : 1.9751965999603271 step5:final Fri Dec 26 22:14:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1401170769: ('0.03654420021770283',), 1401170766: ('0.03654420021770283',), 1401170764: ('0.03654420021770283',), 1401170762: ('0.03654420021770283',), 1401170760: ('0.03654420021770283',), 1401170757: ('0.03654420021770283',), 1401170747: ('0.03654420021770283',), 1401170744: ('0.03654420021770283',), 1401170741: ('0.03654420021770283',), 1401170739: ('0.03654420021770283',), 1401170738: ('0.03654420021770283',), 1401170736: ('0.03654420021770283',), 1401170721: ('0.03654420021770283',), 1401170720: ('0.03654420021770283',)} new output for save of step final : {1401170769: ('0.03654420021770283',), 1401170766: ('0.03654420021770283',), 1401170764: ('0.03654420021770283',), 1401170762: ('0.03654420021770283',), 1401170760: ('0.03654420021770283',), 1401170757: ('0.03654420021770283',), 1401170747: ('0.03654420021770283',), 1401170744: ('0.03654420021770283',), 1401170741: ('0.03654420021770283',), 1401170739: ('0.03654420021770283',), 1401170738: ('0.03654420021770283',), 1401170736: ('0.03654420021770283',), 1401170721: ('0.03654420021770283',), 1401170720: ('0.03654420021770283',)} [1401170769, 1401170766, 1401170764, 1401170762, 1401170760, 1401170757, 1401170747, 1401170744, 1401170741, 1401170739, 1401170738, 1401170736, 1401170721, 1401170720] Looping around the photos to save general results len do output : 14 /1401170769.Didn't retrieve data . /1401170766.Didn't retrieve data . /1401170764.Didn't retrieve data . /1401170762.Didn't retrieve data . /1401170760.Didn't retrieve data . /1401170757.Didn't retrieve data . /1401170747.Didn't retrieve data . /1401170744.Didn't retrieve data . /1401170741.Didn't retrieve data . /1401170739.Didn't retrieve data . /1401170738.Didn't retrieve data . /1401170736.Didn't retrieve data . /1401170721.Didn't retrieve data . /1401170720.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170769', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170766', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170764', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170762', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170760', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170757', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170747', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170744', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170741', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170739', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170738', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170736', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170721', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170720', None, None, None, None, None, '4277538') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.016521930694580078 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1441636085510254 time spend to save output : 0.017133474349975586 total time spend for step 5 : 0.16129708290100098 step6:blur_detection Fri Dec 26 22:14:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac.jpg resize: (2160, 3840) 1401170769 -6.259948159807749 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534.jpg resize: (2160, 3840) 1401170766 -6.733727845487685 treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26.jpg resize: (2160, 3840) 1401170764 -7.182944758284458 treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c.jpg resize: (2160, 3840) 1401170762 -6.81084711063488 treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f.jpg resize: (2160, 3840) 1401170760 -6.91182196343395 treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc.jpg resize: (2160, 3840) 1401170757 -7.031377801440703 treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd.jpg resize: (2160, 3840) 1401170747 -7.078895663137367 treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0.jpg resize: (2160, 3840) 1401170744 -6.862616699221061 treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c.jpg resize: (2160, 3840) 1401170741 -7.040670943956346 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385.jpg resize: (2160, 3840) 1401170739 -6.934408062438398 treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac.jpg resize: (2160, 3840) 1401170738 -6.85337992209976 treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1.jpg resize: (2160, 3840) 1401170736 -7.00863990329619 treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8.jpg resize: (2160, 3840) 1401170721 -6.327701754144164 treat image : temp/1766783428_3683824_1401170720_60604167d6349027b5bb8b241365ed9a.jpg resize: (2160, 3840) 1401170720 -6.414178531766171 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334222_0.png resize: (263, 226) 1401177176 -3.5677696048163745 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334223_0.png resize: (224, 241) 1401177177 -4.132161538359499 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334224_0.png resize: (451, 390) 1401177178 -4.126421890977067 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334226_0.png resize: (139, 381) 1401177179 -4.349739025419779 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334228_0.png resize: (215, 193) 1401177180 -3.655807052851936 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334231_0.png resize: (280, 353) 1401177181 -4.940365366337038 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334234_0.png resize: (162, 370) 1401177182 -4.489231631125158 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334235_0.png resize: (185, 235) 1401177183 -4.645920127987943 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334236_0.png resize: (190, 138) 1401177184 -3.7938347463593303 treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334238_0.png resize: (169, 245) 1401177185 -4.4560762859130145 treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334239_0.png resize: (265, 244) 1401177186 -4.013488437384955 treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334242_0.png resize: (246, 118) 1401177187 -3.9788178049342426 treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334243_0.png resize: (227, 180) 1401177188 -3.969929637518783 treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334248_0.png resize: (152, 230) 1401177189 -4.159243146114678 treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334260_0.png resize: (244, 200) 1401177190 -5.062163800600033 treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334264_0.png resize: (266, 167) 1401177191 -5.4787954881816585 treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334265_0.png resize: (225, 155) 1401177192 -4.427208681261577 treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334268_0.png resize: (228, 160) 1401177193 -4.021061623023976 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334270_0.png resize: (307, 265) 1401177194 -4.462511742383711 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334271_0.png resize: (308, 669) 1401177195 -5.051105673245497 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334273_0.png resize: (253, 219) 1401177196 -4.586569174325374 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334275_0.png resize: (166, 325) 1401177197 -4.10290963997144 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334277_0.png resize: (226, 96) 1401177199 -3.4782755044053713 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334278_0.png resize: (332, 296) 1401177200 -5.454241873264885 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334279_0.png resize: (368, 358) 1401177201 -4.946642644552504 treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334282_0.png resize: (164, 111) 1401177203 -4.530715264621315 treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334284_0.png resize: (388, 242) 1401177204 -3.938017969378737 treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334287_0.png resize: (309, 190) 1401177205 -4.324733734717795 treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334288_0.png resize: (266, 215) 1401177207 -3.6167746970530694 treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334290_0.png resize: (185, 334) 1401177208 -4.606415725814385 treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334294_0.png resize: (114, 114) 1401177209 -2.851431733557392 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334233_0.png resize: (235, 493) 1401177217 -2.5574110554723637 treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334262_0.png resize: (493, 514) 1401177218 -4.941572125397852 treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334266_0.png resize: (294, 200) 1401177219 -3.238004016491231 treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334267_0.png resize: (251, 188) 1401177220 -3.379905934525426 treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334281_0.png resize: (709, 391) 1401177221 -4.867407210286094 treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334298_0.png resize: (204, 275) 1401177222 -4.2382355647174785 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334229_0.png resize: (117, 114) 1401177224 -4.429824941947468 treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334252_0.png resize: (155, 166) 1401177225 -3.937018852226945 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334274_0.png resize: (102, 86) 1401177226 -5.178894592100545 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334276_0.png resize: (105, 174) 1401177227 -5.088700206117259 treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334295_0.png resize: (100, 90) 1401177228 -4.558020713669762 treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334296_0.png resize: (152, 120) 1401177229 -3.3595350049670443 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334221_0.png resize: (347, 888) 1401177242 -4.305501382876816 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334225_0.png resize: (257, 165) 1401177243 -4.744236718769306 treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334227_0.png resize: (342, 324) 1401177244 -4.6212026025040585 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334230_0.png resize: (289, 318) 1401177245 -4.622578972745845 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334232_0.png resize: (138, 164) 1401177246 -4.2221205800745345 treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334237_0.png resize: (108, 219) 1401177247 -4.660518509145796 treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334240_0.png resize: (229, 201) 1401177248 -5.352787067106706 treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334241_0.png resize: (192, 520) 1401177249 -4.6339922440046655 treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334244_0.png resize: (202, 429) 1401177250 -4.494816937889439 treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334245_0.png resize: (356, 350) 1401177251 -5.274652570339422 treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334246_0.png resize: (406, 258) 1401177252 -5.0025035623237715 treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334249_0.png resize: (619, 251) 1401177253 -5.215991359182701 treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334250_0.png resize: (670, 507) 1401177254 -5.803767189417348 treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334251_0.png resize: (223, 183) 1401177255 -4.0425471988300785 treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334253_0.png resize: (227, 130) 1401177256 -3.8405443947707547 treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334254_0.png resize: (426, 372) 1401177257 -4.916300385611478 treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334255_0.png resize: (102, 101) 1401177258 -4.124214799971026 treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334256_0.png resize: (85, 119) 1401177259 -4.2985616813412895 treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334257_0.png resize: (177, 176) 1401177260 -4.692672823556289 treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334258_0.png resize: (171, 105) 1401177261 -4.429383889324352 treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334259_0.png resize: (254, 169) 1401177262 -5.023428637804617 treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334261_0.png resize: (341, 207) 1401177263 -4.889912864027257 treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334263_0.png resize: (263, 302) 1401177264 -4.639994678902837 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334272_0.png resize: (146, 181) 1401177265 -4.406195641233926 treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334283_0.png resize: (759, 773) 1401177266 -5.331742250657478 treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334285_0.png resize: (313, 264) 1401177267 -5.5163797103006 treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334286_0.png resize: (114, 202) 1401177268 -4.214852609606279 treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334289_0.png resize: (109, 239) 1401177269 -3.6187454754349417 treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334291_0.png resize: (159, 177) 1401177271 -4.939109092212317 treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334293_0.png resize: (301, 241) 1401177272 -6.1539050497449805 treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334297_0.png resize: (247, 132) 1401177273 -3.5117234937458615 treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334300_0.png resize: (258, 503) 1401177274 -4.369834687267624 treat image : temp/1766783428_3683824_1401170720_60604167d6349027b5bb8b241365ed9a_rle_crop_4082334301_0.png resize: (296, 216) 1401177275 -3.370915575193864 treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334247_0.png resize: (145, 112) 1401177278 -4.977205436764722 treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334269_0.png resize: (510, 323) 1401177279 -3.9840088384273966 treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334280_0.png resize: (168, 161) 1401177280 -4.867077290327434 treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334292_0.png resize: (99, 104) 1401177282 -4.819426548561823 treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334299_0.png resize: (373, 220) 1401177283 -5.263065618703464 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 95 time used for this insertion : 0.016429662704467773 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 95 time used for this insertion : 0.01793837547302246 save missing photos in datou_result : time spend for datou_step_exec : 54.86367416381836 time spend to save output : 0.04008650779724121 total time spend for step 6 : 54.9037606716156 step7:brightness Fri Dec 26 22:14:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac.jpg treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534.jpg treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26.jpg treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c.jpg treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f.jpg treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc.jpg treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd.jpg treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0.jpg treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c.jpg treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385.jpg treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac.jpg treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1.jpg treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8.jpg treat image : temp/1766783428_3683824_1401170720_60604167d6349027b5bb8b241365ed9a.jpg treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334222_0.png treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334223_0.png treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334224_0.png treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334226_0.png treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334228_0.png treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334231_0.png treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334234_0.png treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334235_0.png treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334236_0.png treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334238_0.png treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334239_0.png treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334242_0.png treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334243_0.png treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334248_0.png treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334260_0.png treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334264_0.png treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334265_0.png treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334268_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334270_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334271_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334273_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334275_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334277_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334278_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334279_0.png treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334282_0.png treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334284_0.png treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334287_0.png treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334288_0.png treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334290_0.png treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334294_0.png treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334233_0.png treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334262_0.png treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334266_0.png treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334267_0.png treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334281_0.png treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334298_0.png treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334229_0.png treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334252_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334274_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334276_0.png treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334295_0.png treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334296_0.png treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334221_0.png treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334225_0.png treat image : temp/1766783428_3683824_1401170769_a1e03594761233b2f7de0403f5fa17ac_rle_crop_4082334227_0.png treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334230_0.png treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334232_0.png treat image : temp/1766783428_3683824_1401170766_5b594abf08a1d7c538a7a282b5606534_rle_crop_4082334237_0.png treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334240_0.png treat image : temp/1766783428_3683824_1401170764_f8f748f6c7fb5c804f5a8e6756459a26_rle_crop_4082334241_0.png treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334244_0.png treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334245_0.png treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334246_0.png treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334249_0.png treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334250_0.png treat image : temp/1766783428_3683824_1401170760_71877b3873db48f267be19efac933e1f_rle_crop_4082334251_0.png treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334253_0.png treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334254_0.png treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334255_0.png treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334256_0.png treat image : temp/1766783428_3683824_1401170757_725d43c5eb6cca1c3492a9df63571fbc_rle_crop_4082334257_0.png treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334258_0.png treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334259_0.png treat image : temp/1766783428_3683824_1401170747_223ce4c9d647a7610de186b73d7179cd_rle_crop_4082334261_0.png treat image : temp/1766783428_3683824_1401170744_e3ce6f26dbdacf253c1700c2a12cd3c0_rle_crop_4082334263_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334272_0.png treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334283_0.png treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334285_0.png treat image : temp/1766783428_3683824_1401170738_ebd2ffdeaed347aa5ab553f9821544ac_rle_crop_4082334286_0.png treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334289_0.png treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334291_0.png treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334293_0.png treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334297_0.png treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334300_0.png treat image : temp/1766783428_3683824_1401170720_60604167d6349027b5bb8b241365ed9a_rle_crop_4082334301_0.png treat image : temp/1766783428_3683824_1401170762_4179dd549e6ce20d85436af37c0e530c_rle_crop_4082334247_0.png treat image : temp/1766783428_3683824_1401170741_30288494c57517dcf2f5c15c49afed5c_rle_crop_4082334269_0.png treat image : temp/1766783428_3683824_1401170739_44c42c5f587a1dbe0c521b7790755385_rle_crop_4082334280_0.png treat image : temp/1766783428_3683824_1401170736_da39cbe89ddd51da23d03d93c83b02e1_rle_crop_4082334292_0.png treat image : temp/1766783428_3683824_1401170721_28168fc254b225cdb355218e2047d5c8_rle_crop_4082334299_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 95 time used for this insertion : 0.018181800842285156 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 95 time used for this insertion : 0.02007317543029785 save missing photos in datou_result : time spend for datou_step_exec : 12.530505418777466 time spend to save output : 0.04472661018371582 total time spend for step 7 : 12.575232028961182 step8:velours_tree Fri Dec 26 22:15:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1029815673828125 time spend to save output : 4.935264587402344e-05 total time spend for step 8 : 0.10303092002868652 step9:send_mail_cod Fri Dec 26 22:15:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29731774_26-12-2025_22_15_08.pdf 29732008 imagette297320081766783708 29732009 imagette297320091766783708 29732010 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette297320101766783708 29732011 change filename to text .change filename to text .change filename to text .change filename to text .imagette297320111766783709 29732012 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette297320121766783709 29732013 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette297320131766783710 29732014 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette297320141766783712 29732016 imagette297320161766783714 29732017 change filename to text .imagette297320171766783714 29732018 imagette297320181766783714 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29731774 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29732008,29732009,29732010,29732011,29732012,29732013,29732014,29732015,29732016,29732017,29732018?tags=mal_croppe,background,carton,autre,metal,papier,pet_clair,environnement,pehd,pet_fonce,flou your option no_mail is active, we will not send the real mail to your client args[1401170769] : ((1401170769, -6.259948159807749, 492609224), (1401170769, -0.41328398795227367, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170766] : ((1401170766, -6.733727845487685, 492609224), (1401170766, -0.5221415429180605, 501862349), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170764] : ((1401170764, -7.182944758284458, 492609224), (1401170764, -0.4465706939521631, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170762] : ((1401170762, -6.81084711063488, 492609224), (1401170762, -0.22821415558876262, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170760] : ((1401170760, -6.91182196343395, 492609224), (1401170760, -0.39637909793611825, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170757] : ((1401170757, -7.031377801440703, 492609224), (1401170757, -0.3277934100450053, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170747] : ((1401170747, -7.078895663137367, 492609224), (1401170747, -0.21908612415542655, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170744] : ((1401170744, -6.862616699221061, 492609224), (1401170744, -0.28288188718361135, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170741] : ((1401170741, -7.040670943956346, 492609224), (1401170741, -0.2909778532508436, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170739] : ((1401170739, -6.934408062438398, 492609224), (1401170739, -0.3169582110144491, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170738] : ((1401170738, -6.85337992209976, 492609224), (1401170738, -0.367743378426724, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170736] : ((1401170736, -7.00863990329619, 492609224), (1401170736, -0.27753000585951393, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170721] : ((1401170721, -6.327701754144164, 492609224), (1401170721, -0.5183661449052598, 501862349), '0.03654420021770283') We are sending mail with results at report@fotonower.com args[1401170720] : ((1401170720, -6.414178531766171, 492609224), (1401170720, -0.47692788542077336, 496442774), '0.03654420021770283') We are sending mail with results at report@fotonower.com refus_total : 0.03654420021770283 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29731774 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29731774_26-12-2025_22_15_08.pdf results_Auto_P29731774_26-12-2025_22_15_08.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29731774_26-12-2025_22_15_08.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29731774','results_Auto_P29731774_26-12-2025_22_15_08.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29731774_26-12-2025_22_15_08.pdf','pdf','','0.83','0.03654420021770283') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1401170769, 1401170766, 1401170764, 1401170762, 1401170760, 1401170757, 1401170747, 1401170744, 1401170741, 1401170739, 1401170738, 1401170736, 1401170721, 1401170720] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170769', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170766', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170764', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170762', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170760', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170757', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170747', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170744', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170741', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170739', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170738', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170736', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170721', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170720', None, None, None, None, None, '4277538') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.01621222496032715 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.920684814453125 time spend to save output : 0.016446352005004883 total time spend for step 9 : 7.93713116645813 step10:split_time_score Fri Dec 26 22:15:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 14),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26122025 29731774 Nombre de photos uploadées : 14 / 23040 (0%) 26122025 29731774 Nombre de photos taguées (types de déchets): 0 / 14 (0%) 26122025 29731774 Nombre de photos taguées (volume) : 0 / 14 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ?????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006723403930664062 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24091339111328125 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.01938292115921462 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29708948_26-12-2025_07_09_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29708948 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29708948 AND mptpi.`type`=3726 To do Qualite : 0.06187620953665258 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29708950_26-12-2025_07_05_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29708950 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29708950 AND mptpi.`type`=3726 To do Qualite : 0.026835068575215205 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29716804_26-12-2025_12_38_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29716804 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29716804 AND mptpi.`type`=3726 To do Qualite : 0.025028412586154306 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29722646_26-12-2025_16_44_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29722646 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29722646 AND mptpi.`type`=3726 To do Qualite : 0.04893544432093284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29717683_26-12-2025_14_09_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29717683 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29717683 AND mptpi.`type`=3726 To do Qualite : 0.08003738968460646 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29717684_26-12-2025_14_14_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29717684 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29717684 AND mptpi.`type`=3594 To do Qualite : 0.0238933522992957 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29719476_26-12-2025_15_08_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29719476 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29719476 AND mptpi.`type`=3726 To do Qualite : 0.07904861467096369 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29722664_26-12-2025_18_02_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29722664 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29722664 AND mptpi.`type`=3726 To do Qualite : 0.01804236402503638 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29728168_26-12-2025_19_49_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29728168 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29728168 AND mptpi.`type`=3726 To do Qualite : 0.08476544255418636 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29727002_26-12-2025_19_08_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29727002 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29727002 AND mptpi.`type`=3726 To do Qualite : 0.022707237272945494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29728171_26-12-2025_19_47_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29728171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29728171 AND mptpi.`type`=3726 To do Qualite : 0.0774388945151749 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29728177_26-12-2025_19_43_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29728177 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29728177 AND mptpi.`type`=3594 To do Qualite : 0.03654420021770283 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29731774_26-12-2025_22_15_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29731774 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29731774 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26122025': {'nb_upload': 14, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1401170769, 1401170766, 1401170764, 1401170762, 1401170760, 1401170757, 1401170747, 1401170744, 1401170741, 1401170739, 1401170738, 1401170736, 1401170721, 1401170720] Looping around the photos to save general results len do output : 1 /29731774Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170769', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170766', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170764', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170762', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170760', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170757', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170747', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170744', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170741', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170739', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170738', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170736', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170721', None, None, None, None, None, '4277538') ('3318', None, None, None, None, None, None, None, '4277538') ('3318', '29731774', '1401170720', None, None, None, None, None, '4277538') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014920949935913086 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3736176490783691 time spend to save output : 0.015173912048339844 total time spend for step 10 : 1.388791561126709 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 14 set_done_treatment 128.66user 131.53system 4:52.57elapsed 88%CPU (0avgtext+0avgdata 5111364maxresident)k 507936inputs+117384outputs (96major+12062602minor)pagefaults 0swaps