python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2425465 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4175967'] with mtr_portfolio_ids : ['29112007'] and first list_photo_ids : [] new path : /proc/2425465/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 15 ; length of list_pids : 15 ; length of list_args : 15 time to download the photos : 3.095109701156616 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Dec 2 21:50:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10332 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-02 21:50:35.292686: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-02 21:50:35.322696: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-02 21:50:35.325002: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2ea4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-02 21:50:35.325065: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-02 21:50:35.330110: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-02 21:50:35.586096: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1af19720 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-02 21:50:35.586162: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-02 21:50:35.588036: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-02 21:50:35.588767: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-02 21:50:35.593407: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-02 21:50:35.611447: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-02 21:50:35.612685: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-02 21:50:35.645644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-02 21:50:35.650995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-02 21:50:35.705107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-02 21:50:35.707026: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-02 21:50:35.707445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-02 21:50:35.708425: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-02 21:50:35.708449: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-02 21:50:35.708462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-02 21:50:35.710621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9570 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-02 21:50:36.151147: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-02 21:50:36.151232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-02 21:50:36.151253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-02 21:50:36.151272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-02 21:50:36.151292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-02 21:50:36.151310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-02 21:50:36.151328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-02 21:50:36.151346: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-02 21:50:36.152953: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-02 21:50:36.154387: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-02 21:50:36.154430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-02 21:50:36.154449: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-02 21:50:36.154467: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-02 21:50:36.154484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-02 21:50:36.154500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-02 21:50:36.154517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-02 21:50:36.154534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-02 21:50:36.156052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-02 21:50:36.156082: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-02 21:50:36.156090: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-02 21:50:36.156098: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-02 21:50:36.157439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9570 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-02 21:50:50.041815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-02 21:50:50.258818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 Detection mask done ! Trying to reset tf kernel 2425988 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 162 tf kernel not reseted sub process len(results) : 15 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 15 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10332 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1854, 2670, 2124, 2928] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011205673217773438 nb_pixel_total : 20780 time to create 1 rle with old method : 0.025050878524780273 length of segment : 230 DEBUG bbox = [1362, 672, 1554, 930] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008566379547119141 nb_pixel_total : 40496 time to create 1 rle with old method : 0.047322988510131836 length of segment : 185 DEBUG bbox = [1818, 582, 2034, 720] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005218982696533203 nb_pixel_total : 13539 time to create 1 rle with old method : 0.016141891479492188 length of segment : 196 DEBUG bbox = [1104, 1074, 1578, 2142] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.15409135818481445 nb_pixel_total : 319898 time to create 1 rle with new method : 0.015949726104736328 length of segment : 521 DEBUG bbox = [6, 2958, 126, 3120] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003325939178466797 nb_pixel_total : 13293 time to create 1 rle with old method : 0.01604914665222168 length of segment : 102 DEBUG bbox = [1596, 900, 1902, 1266] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014770030975341797 nb_pixel_total : 57895 time to create 1 rle with old method : 0.06604838371276855 length of segment : 425 DEBUG bbox = [426, 2712, 960, 2976] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015408992767333984 nb_pixel_total : 45805 time to create 1 rle with old method : 0.05281352996826172 length of segment : 728 DEBUG bbox = [648, 2076, 1458, 2676] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004964351654052734 nb_pixel_total : 261214 time to create 1 rle with new method : 0.01707291603088379 length of segment : 879 DEBUG bbox = [1596, 2496, 2022, 2856] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002135753631591797 nb_pixel_total : 71203 time to create 1 rle with old method : 0.08576130867004395 length of segment : 402 DEBUG bbox = [192, 2862, 504, 3096] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001119375228881836 nb_pixel_total : 60556 time to create 1 rle with old method : 0.06975913047790527 length of segment : 322 DEBUG bbox = [1056, 1794, 1200, 2136] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005724430084228516 nb_pixel_total : 32724 time to create 1 rle with old method : 0.03900623321533203 length of segment : 127 DEBUG bbox = [1140, 1104, 1500, 1548] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018606185913085938 nb_pixel_total : 93828 time to create 1 rle with old method : 0.10757136344909668 length of segment : 339 DEBUG bbox = [786, 2556, 1398, 3246] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00507807731628418 nb_pixel_total : 239599 time to create 1 rle with new method : 0.013221025466918945 length of segment : 688 DEBUG bbox = [762, 3138, 900, 3264] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043702125549316406 nb_pixel_total : 11056 time to create 1 rle with old method : 0.019015789031982422 length of segment : 128 DEBUG bbox = [828, 2748, 1530, 3288] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005876302719116211 nb_pixel_total : 209123 time to create 1 rle with new method : 0.012475728988647461 length of segment : 588 DEBUG bbox = [1686, 1512, 1956, 1752] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011649131774902344 nb_pixel_total : 33341 time to create 1 rle with old method : 0.03911185264587402 length of segment : 276 DEBUG bbox = [1458, 648, 1956, 1008] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002961397171020508 nb_pixel_total : 93714 time to create 1 rle with old method : 0.10720419883728027 length of segment : 508 DEBUG bbox = [774, 348, 1086, 564] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018317699432373047 nb_pixel_total : 35868 time to create 1 rle with old method : 0.04425454139709473 length of segment : 252 DEBUG bbox = [2004, 642, 2142, 966] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008046627044677734 nb_pixel_total : 34427 time to create 1 rle with old method : 0.04348897933959961 length of segment : 138 DEBUG bbox = [1854, 1902, 2130, 2118] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010809898376464844 nb_pixel_total : 32575 time to create 1 rle with old method : 0.03795814514160156 length of segment : 269 DEBUG bbox = [1176, 2322, 1302, 2670] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005469322204589844 nb_pixel_total : 21289 time to create 1 rle with old method : 0.027644872665405273 length of segment : 109 DEBUG bbox = [1626, 624, 1896, 924] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011780261993408203 nb_pixel_total : 51097 time to create 1 rle with old method : 0.05933547019958496 length of segment : 243 DEBUG bbox = [1212, 2094, 1422, 2274] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00067901611328125 nb_pixel_total : 22222 time to create 1 rle with old method : 0.029466629028320312 length of segment : 177 DEBUG bbox = [516, 1284, 780, 1632] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001352071762084961 nb_pixel_total : 45466 time to create 1 rle with old method : 0.05496716499328613 length of segment : 303 DEBUG bbox = [24, 2484, 192, 2730] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006697177886962891 nb_pixel_total : 26887 time to create 1 rle with old method : 0.03155350685119629 length of segment : 165 DEBUG bbox = [1392, 2628, 2040, 2958] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0030753612518310547 nb_pixel_total : 146301 time to create 1 rle with old method : 0.16892457008361816 length of segment : 661 DEBUG bbox = [858, 1878, 1200, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022759437561035156 nb_pixel_total : 60223 time to create 1 rle with old method : 0.06898832321166992 length of segment : 308 DEBUG bbox = [546, 2472, 708, 2646] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006225109100341797 nb_pixel_total : 16144 time to create 1 rle with old method : 0.01886916160583496 length of segment : 146 DEBUG bbox = [660, 3114, 1080, 3300] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015060901641845703 nb_pixel_total : 31565 time to create 1 rle with old method : 0.03644728660583496 length of segment : 419 DEBUG bbox = [714, 2010, 984, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013263225555419922 nb_pixel_total : 34579 time to create 1 rle with old method : 0.044133663177490234 length of segment : 232 DEBUG bbox = [912, 756, 1152, 882] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007314682006835938 nb_pixel_total : 16901 time to create 1 rle with old method : 0.020177602767944336 length of segment : 224 DEBUG bbox = [246, 582, 450, 804] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010066032409667969 nb_pixel_total : 17389 time to create 1 rle with old method : 0.021671533584594727 length of segment : 172 DEBUG bbox = [0, 6, 408, 366] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019216537475585938 nb_pixel_total : 92360 time to create 1 rle with old method : 0.10931682586669922 length of segment : 374 DEBUG bbox = [66, 2034, 570, 2394] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023212432861328125 nb_pixel_total : 115049 time to create 1 rle with old method : 0.133345365524292 length of segment : 495 DEBUG bbox = [12, 1104, 564, 1842] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0053179264068603516 nb_pixel_total : 287743 time to create 1 rle with new method : 0.013907194137573242 length of segment : 511 DEBUG bbox = [1038, 1140, 1392, 1650] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021567344665527344 nb_pixel_total : 115376 time to create 1 rle with old method : 0.13469910621643066 length of segment : 325 DEBUG bbox = [336, 360, 654, 528] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009942054748535156 nb_pixel_total : 22616 time to create 1 rle with old method : 0.027610301971435547 length of segment : 254 DEBUG bbox = [24, 2658, 180, 2838] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004878044128417969 nb_pixel_total : 17316 time to create 1 rle with old method : 0.020773649215698242 length of segment : 147 DEBUG bbox = [24, 1758, 198, 1980] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006492137908935547 nb_pixel_total : 24100 time to create 1 rle with old method : 0.028494834899902344 length of segment : 157 DEBUG bbox = [1158, 1284, 1380, 1530] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007739067077636719 nb_pixel_total : 31176 time to create 1 rle with old method : 0.03659462928771973 length of segment : 202 DEBUG bbox = [1026, 660, 1170, 828] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004100799560546875 nb_pixel_total : 11714 time to create 1 rle with old method : 0.014117002487182617 length of segment : 142 DEBUG bbox = [1470, 2058, 1782, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008406639099121094 nb_pixel_total : 39822 time to create 1 rle with old method : 0.04557156562805176 length of segment : 274 DEBUG bbox = [1584, 2262, 1788, 2388] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004994869232177734 nb_pixel_total : 15167 time to create 1 rle with old method : 0.018282651901245117 length of segment : 170 DEBUG bbox = [384, 1200, 534, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005261898040771484 nb_pixel_total : 12996 time to create 1 rle with old method : 0.016597747802734375 length of segment : 133 DEBUG bbox = [702, 318, 870, 522] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007171630859375 nb_pixel_total : 16234 time to create 1 rle with old method : 0.019449949264526367 length of segment : 129 DEBUG bbox = [1626, 1446, 1890, 1710] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011703968048095703 nb_pixel_total : 48260 time to create 1 rle with old method : 0.05596590042114258 length of segment : 269 DEBUG bbox = [24, 300, 210, 468] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 21537 time to create 1 rle with old method : 0.025430679321289062 length of segment : 181 DEBUG bbox = [24, 570, 348, 1236] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003405332565307617 nb_pixel_total : 132133 time to create 1 rle with old method : 0.15170860290527344 length of segment : 289 DEBUG bbox = [1704, 1320, 1854, 1512] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006291866302490234 nb_pixel_total : 12396 time to create 1 rle with old method : 0.014578819274902344 length of segment : 114 DEBUG bbox = [1158, 252, 1362, 396] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 20039 time to create 1 rle with old method : 0.024265050888061523 length of segment : 188 DEBUG bbox = [576, 2652, 858, 2892] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013833045959472656 nb_pixel_total : 35924 time to create 1 rle with old method : 0.04249930381774902 length of segment : 242 DEBUG bbox = [336, 2376, 648, 2742] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017397403717041016 nb_pixel_total : 26728 time to create 1 rle with old method : 0.03117060661315918 length of segment : 300 DEBUG bbox = [1500, 1860, 1794, 1998] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009889602661132812 nb_pixel_total : 26479 time to create 1 rle with old method : 0.031070470809936523 length of segment : 289 DEBUG bbox = [936, 1788, 1152, 2088] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011806488037109375 nb_pixel_total : 38730 time to create 1 rle with old method : 0.046486854553222656 length of segment : 212 DEBUG bbox = [1344, 1998, 1572, 2232] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010113716125488281 nb_pixel_total : 17093 time to create 1 rle with old method : 0.02077627182006836 length of segment : 219 DEBUG bbox = [2034, 1674, 2154, 1920] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004763603210449219 nb_pixel_total : 19727 time to create 1 rle with old method : 0.023946046829223633 length of segment : 123 DEBUG bbox = [1956, 960, 2160, 1194] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008263587951660156 nb_pixel_total : 34481 time to create 1 rle with old method : 0.041091203689575195 length of segment : 195 DEBUG bbox = [174, 660, 522, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002444028854370117 nb_pixel_total : 90518 time to create 1 rle with old method : 0.10517048835754395 length of segment : 453 DEBUG bbox = [444, 396, 696, 624] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008368492126464844 nb_pixel_total : 31330 time to create 1 rle with old method : 0.036075592041015625 length of segment : 225 DEBUG bbox = [888, 2346, 1146, 2460] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006086826324462891 nb_pixel_total : 20059 time to create 1 rle with old method : 0.023355722427368164 length of segment : 240 DEBUG bbox = [1464, 516, 1884, 708] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001117706298828125 nb_pixel_total : 43673 time to create 1 rle with old method : 0.05123138427734375 length of segment : 449 DEBUG bbox = [654, 2898, 804, 3048] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 12051 time to create 1 rle with old method : 0.016620874404907227 length of segment : 146 DEBUG bbox = [1026, 1944, 1230, 2130] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009541511535644531 nb_pixel_total : 26296 time to create 1 rle with old method : 0.032454729080200195 length of segment : 200 DEBUG bbox = [396, 2250, 624, 2484] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008645057678222656 nb_pixel_total : 20571 time to create 1 rle with old method : 0.025171995162963867 length of segment : 259 DEBUG bbox = [12, 336, 282, 912] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020940303802490234 nb_pixel_total : 80131 time to create 1 rle with old method : 0.09453177452087402 length of segment : 262 DEBUG bbox = [900, 606, 1062, 762] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005137920379638672 nb_pixel_total : 15324 time to create 1 rle with old method : 0.018204927444458008 length of segment : 160 DEBUG bbox = [1356, 552, 1932, 1764] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.008722543716430664 nb_pixel_total : 237247 time to create 1 rle with new method : 0.3765218257904053 length of segment : 1069 DEBUG bbox = [702, 336, 1218, 588] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018887519836425781 nb_pixel_total : 59151 time to create 1 rle with old method : 0.06687808036804199 length of segment : 420 DEBUG bbox = [768, 828, 1134, 1224] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002087831497192383 nb_pixel_total : 79162 time to create 1 rle with old method : 0.0928950309753418 length of segment : 378 DEBUG bbox = [594, 1458, 876, 2028] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021963119506835938 nb_pixel_total : 63123 time to create 1 rle with old method : 0.07360029220581055 length of segment : 248 DEBUG bbox = [336, 1998, 594, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011708736419677734 nb_pixel_total : 29149 time to create 1 rle with old method : 0.03434920310974121 length of segment : 254 DEBUG bbox = [102, 126, 630, 492] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031385421752929688 nb_pixel_total : 127334 time to create 1 rle with old method : 0.14585304260253906 length of segment : 517 DEBUG bbox = [246, 2580, 366, 2820] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005261898040771484 nb_pixel_total : 16684 time to create 1 rle with old method : 0.01999497413635254 length of segment : 93 DEBUG bbox = [966, 384, 1332, 966] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0030112266540527344 nb_pixel_total : 129700 time to create 1 rle with old method : 0.14947032928466797 length of segment : 365 DEBUG bbox = [12, 1092, 114, 1218] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003368854522705078 nb_pixel_total : 9102 time to create 1 rle with old method : 0.01102590560913086 length of segment : 94 time spent for convertir_results : 7.996555805206299 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 75 chid ids of type : 3594 Number RLEs to save : 22228 save missing photos in datou_result : time spend for datou_step_exec : 103.38014149665833 time spend to save output : 1.4816555976867676 total time spend for step 1 : 104.86179709434509 step2:crop_condition Tue Dec 2 21:52:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 15 ! batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764708748_2425465 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597325_0.png', 0, 129, 196, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597328_0.png', 0, 347, 292, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597333_0.png', 0, 318, 127, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597334_0.png', 0, 391, 339, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597337_0.png', 0, 485, 587, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597338_0.png', 0, 226, 253, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597339_0.png', 0, 346, 453, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597344_0.png', 0, 292, 243, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597345_0.png', 0, 160, 177, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597346_0.png', 0, 347, 260, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597349_0.png', 0, 395, 264, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597352_0.png', 0, 262, 229, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597354_0.png', 0, 209, 171, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597355_0.png', 0, 320, 364, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597357_0.png', 0, 738, 510, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597358_0.png', 0, 465, 298, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478472_30aa927966e7cd28f13892e81df4fabc_rle_crop_4055597359_0.png', 0, 157, 247, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597362_0.png', 0, 225, 202, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597375_0.png', 0, 130, 289, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597377_0.png', 0, 195, 219, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597378_0.png', 0, 241, 119, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597380_0.png', 0, 454, 312, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597382_0.png', 0, 102, 238, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597385_0.png', 0, 184, 197, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597386_0.png', 0, 197, 175, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597391_0.png', 0, 380, 327, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597395_0.png', 0, 219, 88, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708755), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597396_0.png', 0, 558, 350, 0, 1764708755,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.191192150115967 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764708763_2425465 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597329_0.png', 0, 246, 474, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597332_0.png', 0, 231, 309, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597343_0.png', 0, 301, 109, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597348_0.png', 0, 304, 640, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597350_0.png', 0, 168, 146, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597351_0.png', 0, 155, 406, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597353_0.png', 0, 101, 224, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597360_0.png', 0, 154, 146, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597361_0.png', 0, 211, 157, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597363_0.png', 0, 145, 142, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597367_0.png', 0, 188, 129, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597373_0.png', 0, 226, 242, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597381_0.png', 0, 198, 223, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597392_0.png', 0, 493, 248, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708766), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597394_0.png', 0, 321, 517, 0, 1764708766,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.798229694366455 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764708770_2425465 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708772), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597336_0.png', 0, 111, 128, 0, 1764708772,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708772), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597340_0.png', 0, 202, 251, 0, 1764708772,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708772), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597371_0.png', 0, 145, 112, 0, 1764708772,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708772), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597372_0.png', 0, 129, 187, 0, 1764708772,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708772), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597384_0.png', 0, 123, 138, 0, 1764708772,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708772), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597388_0.png', 0, 119, 160, 0, 1764708772,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.449380397796631 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764708783_2425465 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597323_0.png', 0, 195, 220, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597326_0.png', 0, 1039, 449, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597327_0.png', 0, 160, 94, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597330_0.png', 0, 533, 793, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597331_0.png', 0, 336, 371, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597335_0.png', 0, 677, 548, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597341_0.png', 0, 313, 136, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597342_0.png', 0, 201, 267, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597347_0.png', 0, 217, 164, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597356_0.png', 0, 338, 492, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597366_0.png', 0, 117, 133, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478429_9c631a0858f894c7ad092a52ea125ae0_rle_crop_4055597369_0.png', 0, 158, 179, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597370_0.png', 0, 597, 264, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597374_0.png', 0, 311, 272, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597376_0.png', 0, 286, 200, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597379_0.png', 0, 221, 192, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597383_0.png', 0, 160, 388, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597387_0.png', 0, 481, 257, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597389_0.png', 0, 1098, 563, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597393_0.png', 0, 272, 218, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708787), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597397_0.png', 0, 118, 92, 0, 1764708787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.320867300033569 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764708792_2425465 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708792), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597364_0.png', 0, 174, 269, 0, 1764708792,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708792), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597365_0.png', 0, 116, 170, 0, 1764708792,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708792), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478429_9c631a0858f894c7ad092a52ea125ae0_rle_crop_4055597368_0.png', 0, 253, 243, 0, 1764708792,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1942999362945557 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764708795_2425465 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708795), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597324_0.png', 0, 252, 183, 0, 1764708795,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764708795), 0.0, 0.0, 14, '', 0, 0, '1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597390_0.png', 0, 181, 415, 0, 1764708795,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8465855121612549 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1397478601, 1397478600, 1397478598, 1397478569, 1397478490, 1397478475, 1397478472, 1397478466, 1397478464, 1397478429, 1397478205, 1397478114, 1397478073, 1397478049, 1397478043] Looping around the photos to save general results len do output : 75 /1397489638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397489717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478601', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478600', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478598', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478569', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478490', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478475', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478472', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478466', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478464', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478429', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478205', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478114', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478073', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478049', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478043', None, None, None, None, None, '4175967') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 240 time used for this insertion : 0.049741268157958984 save_final save missing photos in datou_result : time spend for datou_step_exec : 59.6369104385376 time spend to save output : 0.05306839942932129 total time spend for step 2 : 59.68997883796692 step3:rle_unique_nms_with_priority Tue Dec 2 21:53:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 6.310954809188843 time for calcul the mask position with numpy : 0.5922696590423584 nb_pixel_total : 7450277 time to create 1 rle with new method : 1.2065389156341553 time for calcul the mask position with numpy : 0.027325868606567383 nb_pixel_total : 71203 time to create 1 rle with old method : 0.08137869834899902 time for calcul the mask position with numpy : 0.0283963680267334 nb_pixel_total : 261214 time to create 1 rle with new method : 1.1590232849121094 time for calcul the mask position with numpy : 0.0303957462310791 nb_pixel_total : 45805 time to create 1 rle with old method : 0.07602524757385254 time for calcul the mask position with numpy : 0.032742977142333984 nb_pixel_total : 57895 time to create 1 rle with old method : 0.0882561206817627 time for calcul the mask position with numpy : 0.025946855545043945 nb_pixel_total : 13293 time to create 1 rle with old method : 0.015096902847290039 time for calcul the mask position with numpy : 0.028343915939331055 nb_pixel_total : 319898 time to create 1 rle with new method : 0.8095912933349609 time for calcul the mask position with numpy : 0.026448965072631836 nb_pixel_total : 13539 time to create 1 rle with old method : 0.015298128128051758 time for calcul the mask position with numpy : 0.03370070457458496 nb_pixel_total : 40496 time to create 1 rle with old method : 0.05041813850402832 time for calcul the mask position with numpy : 0.03268313407897949 nb_pixel_total : 20780 time to create 1 rle with old method : 0.023369550704956055 create new chi : 4.479875326156616 time to delete rle : 0.022345304489135742 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9496 TO DO : save crop sub photo not yet done ! save time : 0.6519365310668945 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.79685378074646 time for calcul the mask position with numpy : 0.9682750701904297 nb_pixel_total : 7867693 time to create 1 rle with new method : 1.0420823097229004 time for calcul the mask position with numpy : 0.026436567306518555 nb_pixel_total : 239599 time to create 1 rle with new method : 0.9101345539093018 time for calcul the mask position with numpy : 0.025206565856933594 nb_pixel_total : 93828 time to create 1 rle with old method : 0.10651445388793945 time for calcul the mask position with numpy : 0.026149988174438477 nb_pixel_total : 32724 time to create 1 rle with old method : 0.03711891174316406 time for calcul the mask position with numpy : 0.02677631378173828 nb_pixel_total : 60556 time to create 1 rle with old method : 0.07043290138244629 create new chi : 3.31650710105896 time to delete rle : 0.0006642341613769531 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5112 TO DO : save crop sub photo not yet done ! save time : 0.371387243270874 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 5.115201473236084 time for calcul the mask position with numpy : 0.6642093658447266 nb_pixel_total : 7844296 time to create 1 rle with new method : 1.4920334815979004 time for calcul the mask position with numpy : 0.035352230072021484 nb_pixel_total : 32575 time to create 1 rle with old method : 0.03546571731567383 time for calcul the mask position with numpy : 0.039838552474975586 nb_pixel_total : 34427 time to create 1 rle with old method : 0.03788399696350098 time for calcul the mask position with numpy : 0.04220294952392578 nb_pixel_total : 35868 time to create 1 rle with old method : 0.039026737213134766 time for calcul the mask position with numpy : 0.04164385795593262 nb_pixel_total : 93714 time to create 1 rle with old method : 0.1063530445098877 time for calcul the mask position with numpy : 0.04231071472167969 nb_pixel_total : 33341 time to create 1 rle with old method : 0.03742384910583496 time for calcul the mask position with numpy : 0.04248380661010742 nb_pixel_total : 209123 time to create 1 rle with new method : 0.7607123851776123 time for calcul the mask position with numpy : 0.04024648666381836 nb_pixel_total : 11056 time to create 1 rle with old method : 0.01253819465637207 create new chi : 3.5475099086761475 time to delete rle : 0.0016095638275146484 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 6478 TO DO : save crop sub photo not yet done ! save time : 0.4370458126068115 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 4.1622631549835205 time for calcul the mask position with numpy : 1.067981481552124 nb_pixel_total : 7981138 time to create 1 rle with new method : 1.1823794841766357 time for calcul the mask position with numpy : 0.03959918022155762 nb_pixel_total : 146301 time to create 1 rle with old method : 0.16735053062438965 time for calcul the mask position with numpy : 0.039656877517700195 nb_pixel_total : 26887 time to create 1 rle with old method : 0.030756235122680664 time for calcul the mask position with numpy : 0.04439520835876465 nb_pixel_total : 45466 time to create 1 rle with old method : 0.05429506301879883 time for calcul the mask position with numpy : 0.03125190734863281 nb_pixel_total : 22222 time to create 1 rle with old method : 0.027574777603149414 time for calcul the mask position with numpy : 0.04053783416748047 nb_pixel_total : 51097 time to create 1 rle with old method : 0.05865168571472168 time for calcul the mask position with numpy : 0.040308475494384766 nb_pixel_total : 21289 time to create 1 rle with old method : 0.024427175521850586 create new chi : 2.895390033721924 time to delete rle : 0.000989675521850586 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5476 TO DO : save crop sub photo not yet done ! save time : 0.3990912437438965 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.436605930328369 time for calcul the mask position with numpy : 0.7739949226379395 nb_pixel_total : 8117599 time to create 1 rle with new method : 1.1068906784057617 time for calcul the mask position with numpy : 0.024753093719482422 nb_pixel_total : 17389 time to create 1 rle with old method : 0.019685745239257812 time for calcul the mask position with numpy : 0.02484440803527832 nb_pixel_total : 16901 time to create 1 rle with old method : 0.019229888916015625 time for calcul the mask position with numpy : 0.026181936264038086 nb_pixel_total : 34579 time to create 1 rle with old method : 0.039235830307006836 time for calcul the mask position with numpy : 0.02539968490600586 nb_pixel_total : 31565 time to create 1 rle with old method : 0.03575015068054199 time for calcul the mask position with numpy : 0.026129961013793945 nb_pixel_total : 16144 time to create 1 rle with old method : 0.018381595611572266 time for calcul the mask position with numpy : 0.02558112144470215 nb_pixel_total : 60223 time to create 1 rle with old method : 0.07145237922668457 create new chi : 2.2830355167388916 time to delete rle : 0.0009424686431884766 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5162 TO DO : save crop sub photo not yet done ! save time : 0.38131141662597656 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.3630709648132324 time for calcul the mask position with numpy : 1.9799220561981201 nb_pixel_total : 7683872 time to create 1 rle with new method : 1.246325969696045 time for calcul the mask position with numpy : 0.02546525001525879 nb_pixel_total : 115376 time to create 1 rle with old method : 0.12930583953857422 time for calcul the mask position with numpy : 0.02665233612060547 nb_pixel_total : 287743 time to create 1 rle with new method : 1.0442030429840088 time for calcul the mask position with numpy : 0.02645111083984375 nb_pixel_total : 115049 time to create 1 rle with old method : 0.12911057472229004 time for calcul the mask position with numpy : 0.027545928955078125 nb_pixel_total : 92360 time to create 1 rle with old method : 0.10736894607543945 create new chi : 4.815775632858276 time to delete rle : 0.0009925365447998047 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 5570 TO DO : save crop sub photo not yet done ! save time : 0.42475032806396484 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.6740899085998535 time for calcul the mask position with numpy : 0.8625929355621338 nb_pixel_total : 8271784 time to create 1 rle with new method : 1.158139705657959 time for calcul the mask position with numpy : 0.0345003604888916 nb_pixel_total : 22616 time to create 1 rle with old method : 0.025639772415161133 create new chi : 2.1269307136535645 time to delete rle : 0.0005543231964111328 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2668 TO DO : save crop sub photo not yet done ! save time : 0.2199859619140625 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.490250825881958 time for calcul the mask position with numpy : 1.0578818321228027 nb_pixel_total : 8210094 time to create 1 rle with new method : 1.1783018112182617 time for calcul the mask position with numpy : 0.03184676170349121 nb_pixel_total : 11714 time to create 1 rle with old method : 0.013330936431884766 time for calcul the mask position with numpy : 0.024729490280151367 nb_pixel_total : 31176 time to create 1 rle with old method : 0.03525686264038086 time for calcul the mask position with numpy : 0.02520585060119629 nb_pixel_total : 24100 time to create 1 rle with old method : 0.02732229232788086 time for calcul the mask position with numpy : 0.026053905487060547 nb_pixel_total : 17316 time to create 1 rle with old method : 0.01977252960205078 create new chi : 2.4843058586120605 time to delete rle : 0.0005629062652587891 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3456 TO DO : save crop sub photo not yet done ! save time : 0.26783132553100586 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.7331275939941406 time for calcul the mask position with numpy : 0.7327349185943604 nb_pixel_total : 8210181 time to create 1 rle with new method : 0.9634301662445068 time for calcul the mask position with numpy : 0.02522420883178711 nb_pixel_total : 16234 time to create 1 rle with old method : 0.0184171199798584 time for calcul the mask position with numpy : 0.025070905685424805 nb_pixel_total : 12996 time to create 1 rle with old method : 0.014761209487915039 time for calcul the mask position with numpy : 0.026155710220336914 nb_pixel_total : 15167 time to create 1 rle with old method : 0.0172727108001709 time for calcul the mask position with numpy : 0.025677204132080078 nb_pixel_total : 39822 time to create 1 rle with old method : 0.050627946853637695 create new chi : 1.9466438293457031 time to delete rle : 0.0008213520050048828 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3572 TO DO : save crop sub photo not yet done ! save time : 0.2767369747161865 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 1.4722611904144287 time for calcul the mask position with numpy : 0.8045117855072021 nb_pixel_total : 8224603 time to create 1 rle with new method : 0.8536114692687988 time for calcul the mask position with numpy : 0.027937889099121094 nb_pixel_total : 21537 time to create 1 rle with old method : 0.03607368469238281 time for calcul the mask position with numpy : 0.027820110321044922 nb_pixel_total : 48260 time to create 1 rle with old method : 0.06386828422546387 create new chi : 1.8654024600982666 time to delete rle : 0.0005538463592529297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3060 TO DO : save crop sub photo not yet done ! save time : 0.2839689254760742 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 6.3761773109436035 time for calcul the mask position with numpy : 0.9962689876556396 nb_pixel_total : 7984878 time to create 1 rle with new method : 1.5170841217041016 time for calcul the mask position with numpy : 0.03336381912231445 nb_pixel_total : 17093 time to create 1 rle with old method : 0.019051551818847656 time for calcul the mask position with numpy : 0.024868249893188477 nb_pixel_total : 38730 time to create 1 rle with old method : 0.042705535888671875 time for calcul the mask position with numpy : 0.025669574737548828 nb_pixel_total : 26479 time to create 1 rle with old method : 0.029174089431762695 time for calcul the mask position with numpy : 0.025913476943969727 nb_pixel_total : 26728 time to create 1 rle with old method : 0.035088300704956055 time for calcul the mask position with numpy : 0.02742791175842285 nb_pixel_total : 35924 time to create 1 rle with old method : 0.04052376747131348 time for calcul the mask position with numpy : 0.024956464767456055 nb_pixel_total : 20039 time to create 1 rle with old method : 0.022229909896850586 time for calcul the mask position with numpy : 0.028614521026611328 nb_pixel_total : 12396 time to create 1 rle with old method : 0.013750314712524414 time for calcul the mask position with numpy : 0.042235374450683594 nb_pixel_total : 132133 time to create 1 rle with old method : 0.14772415161132812 create new chi : 3.1441032886505127 time to delete rle : 0.0010788440704345703 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5866 TO DO : save crop sub photo not yet done ! save time : 0.42769432067871094 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 4.022104263305664 time for calcul the mask position with numpy : 1.2539613246917725 nb_pixel_total : 8098285 time to create 1 rle with new method : 0.7322375774383545 time for calcul the mask position with numpy : 0.027798891067504883 nb_pixel_total : 20059 time to create 1 rle with old method : 0.029811859130859375 time for calcul the mask position with numpy : 0.025745868682861328 nb_pixel_total : 31330 time to create 1 rle with old method : 0.03559231758117676 time for calcul the mask position with numpy : 0.02620220184326172 nb_pixel_total : 90518 time to create 1 rle with old method : 0.1022038459777832 time for calcul the mask position with numpy : 0.02526068687438965 nb_pixel_total : 34481 time to create 1 rle with old method : 0.03948688507080078 time for calcul the mask position with numpy : 0.02702808380126953 nb_pixel_total : 19727 time to create 1 rle with old method : 0.022420883178710938 create new chi : 2.409703016281128 time to delete rle : 0.0008718967437744141 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 4632 TO DO : save crop sub photo not yet done ! save time : 0.35126471519470215 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 3.2493724822998047 time for calcul the mask position with numpy : 0.8920068740844727 nb_pixel_total : 8191809 time to create 1 rle with new method : 1.0807769298553467 time for calcul the mask position with numpy : 0.02584099769592285 nb_pixel_total : 20571 time to create 1 rle with old method : 0.023429155349731445 time for calcul the mask position with numpy : 0.02524733543395996 nb_pixel_total : 26296 time to create 1 rle with old method : 0.029596805572509766 time for calcul the mask position with numpy : 0.024407386779785156 nb_pixel_total : 12051 time to create 1 rle with old method : 0.013833284378051758 time for calcul the mask position with numpy : 0.024489641189575195 nb_pixel_total : 43673 time to create 1 rle with old method : 0.04979419708251953 create new chi : 2.2355399131774902 time to delete rle : 0.0006616115570068359 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 4268 TO DO : save crop sub photo not yet done ! save time : 0.3160884380340576 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 4.269048452377319 time for calcul the mask position with numpy : 0.9971585273742676 nb_pixel_total : 7823385 time to create 1 rle with new method : 1.1214277744293213 time for calcul the mask position with numpy : 0.026858806610107422 nb_pixel_total : 79162 time to create 1 rle with old method : 0.08958959579467773 time for calcul the mask position with numpy : 0.02741837501525879 nb_pixel_total : 59151 time to create 1 rle with old method : 0.06636238098144531 time for calcul the mask position with numpy : 0.028195619583129883 nb_pixel_total : 237247 time to create 1 rle with new method : 1.2996492385864258 time for calcul the mask position with numpy : 0.030094385147094727 nb_pixel_total : 15324 time to create 1 rle with old method : 0.01743769645690918 time for calcul the mask position with numpy : 0.025773048400878906 nb_pixel_total : 80131 time to create 1 rle with old method : 0.09009957313537598 create new chi : 3.8989944458007812 time to delete rle : 0.0014350414276123047 batch 1 Loaded 11 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6738 TO DO : save crop sub photo not yet done ! save time : 0.5014646053314209 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.4693422317504883 time for calcul the mask position with numpy : 1.2138915061950684 nb_pixel_total : 7919308 time to create 1 rle with new method : 1.1930160522460938 time for calcul the mask position with numpy : 0.026079416275024414 nb_pixel_total : 9102 time to create 1 rle with old method : 0.01044774055480957 time for calcul the mask position with numpy : 0.02544236183166504 nb_pixel_total : 129700 time to create 1 rle with old method : 0.1460425853729248 time for calcul the mask position with numpy : 0.026860475540161133 nb_pixel_total : 16684 time to create 1 rle with old method : 0.0190279483795166 time for calcul the mask position with numpy : 0.025985240936279297 nb_pixel_total : 127334 time to create 1 rle with old method : 0.1428210735321045 time for calcul the mask position with numpy : 0.026143789291381836 nb_pixel_total : 29149 time to create 1 rle with old method : 0.03310966491699219 time for calcul the mask position with numpy : 0.026746749877929688 nb_pixel_total : 63123 time to create 1 rle with old method : 0.07128024101257324 create new chi : 3.038620948791504 time to delete rle : 0.0009098052978515625 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 5302 TO DO : save crop sub photo not yet done ! save time : 0.40380024909973145 map_output_result : {1397478601: (0.0, 'Should be the crop_list due to order', 0), 1397478600: (0.0, 'Should be the crop_list due to order', 0), 1397478598: (0.0, 'Should be the crop_list due to order', 0), 1397478569: (0.0, 'Should be the crop_list due to order', 0), 1397478490: (0.0, 'Should be the crop_list due to order', 0), 1397478475: (0.0, 'Should be the crop_list due to order', 0), 1397478472: (0.0, 'Should be the crop_list due to order', 0), 1397478466: (0.0, 'Should be the crop_list due to order', 0), 1397478464: (0.0, 'Should be the crop_list due to order', 0), 1397478429: (0.0, 'Should be the crop_list due to order', 0), 1397478205: (0.0, 'Should be the crop_list due to order', 0), 1397478114: (0.0, 'Should be the crop_list due to order', 0), 1397478073: (0.0, 'Should be the crop_list due to order', 0), 1397478049: (0.0, 'Should be the crop_list due to order', 0), 1397478043: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1397478601, 1397478600, 1397478598, 1397478569, 1397478490, 1397478475, 1397478472, 1397478466, 1397478464, 1397478429, 1397478205, 1397478114, 1397478073, 1397478049, 1397478043] Looping around the photos to save general results len do output : 15 /1397478601.Didn't retrieve data . /1397478600.Didn't retrieve data . /1397478598.Didn't retrieve data . /1397478569.Didn't retrieve data . /1397478490.Didn't retrieve data . /1397478475.Didn't retrieve data . /1397478472.Didn't retrieve data . /1397478466.Didn't retrieve data . /1397478464.Didn't retrieve data . /1397478429.Didn't retrieve data . /1397478205.Didn't retrieve data . /1397478114.Didn't retrieve data . /1397478073.Didn't retrieve data . /1397478049.Didn't retrieve data . /1397478043.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478601', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478600', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478598', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478569', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478490', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478475', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478472', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478466', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478464', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478429', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478205', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478114', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478073', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478049', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478043', None, None, None, None, None, '4175967') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.016860485076904297 save_final save missing photos in datou_result : time spend for datou_step_exec : 105.05337238311768 time spend to save output : 0.018116235733032227 total time spend for step 3 : 105.07148861885071 step4:ventilate_hashtags_in_portfolio Tue Dec 2 21:55:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29112007 get user id for portfolio 29112007 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29112007 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','environnement','pehd','papier','pet_clair','mal_croppe','pet_fonce','autre','carton','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29112007 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','environnement','pehd','papier','pet_clair','mal_croppe','pet_fonce','autre','carton','background')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29112007 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','environnement','pehd','papier','pet_clair','mal_croppe','pet_fonce','autre','carton','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29112692,29112693,29112694,29112695,29112696,29112697,29112698,29112699,29112700,29112701,29112702?tags=flou,metal,environnement,pehd,papier,pet_clair,mal_croppe,pet_fonce,autre,carton,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1397478601, 1397478600, 1397478598, 1397478569, 1397478490, 1397478475, 1397478472, 1397478466, 1397478464, 1397478429, 1397478205, 1397478114, 1397478073, 1397478049, 1397478043] Looping around the photos to save general results len do output : 1 /29112007. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478601', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478600', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478598', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478569', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478490', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478475', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478472', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478466', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478464', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478429', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478205', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478114', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478073', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478049', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478043', None, None, None, None, None, '4175967') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.018418073654174805 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.968956708908081 time spend to save output : 0.0189363956451416 total time spend for step 4 : 0.9878931045532227 step5:final Tue Dec 2 21:55:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1397478601: ('0.03646474729938272',), 1397478600: ('0.03646474729938272',), 1397478598: ('0.03646474729938272',), 1397478569: ('0.03646474729938272',), 1397478490: ('0.03646474729938272',), 1397478475: ('0.03646474729938272',), 1397478472: ('0.03646474729938272',), 1397478466: ('0.03646474729938272',), 1397478464: ('0.03646474729938272',), 1397478429: ('0.03646474729938272',), 1397478205: ('0.03646474729938272',), 1397478114: ('0.03646474729938272',), 1397478073: ('0.03646474729938272',), 1397478049: ('0.03646474729938272',), 1397478043: ('0.03646474729938272',)} new output for save of step final : {1397478601: ('0.03646474729938272',), 1397478600: ('0.03646474729938272',), 1397478598: ('0.03646474729938272',), 1397478569: ('0.03646474729938272',), 1397478490: ('0.03646474729938272',), 1397478475: ('0.03646474729938272',), 1397478472: ('0.03646474729938272',), 1397478466: ('0.03646474729938272',), 1397478464: ('0.03646474729938272',), 1397478429: ('0.03646474729938272',), 1397478205: ('0.03646474729938272',), 1397478114: ('0.03646474729938272',), 1397478073: ('0.03646474729938272',), 1397478049: ('0.03646474729938272',), 1397478043: ('0.03646474729938272',)} [1397478601, 1397478600, 1397478598, 1397478569, 1397478490, 1397478475, 1397478472, 1397478466, 1397478464, 1397478429, 1397478205, 1397478114, 1397478073, 1397478049, 1397478043] Looping around the photos to save general results len do output : 15 /1397478601.Didn't retrieve data . /1397478600.Didn't retrieve data . /1397478598.Didn't retrieve data . /1397478569.Didn't retrieve data . /1397478490.Didn't retrieve data . /1397478475.Didn't retrieve data . /1397478472.Didn't retrieve data . /1397478466.Didn't retrieve data . /1397478464.Didn't retrieve data . /1397478429.Didn't retrieve data . /1397478205.Didn't retrieve data . /1397478114.Didn't retrieve data . /1397478073.Didn't retrieve data . /1397478049.Didn't retrieve data . /1397478043.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478601', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478600', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478598', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478569', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478490', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478475', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478472', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478466', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478464', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478429', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478205', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478114', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478073', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478049', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478043', None, None, None, None, None, '4175967') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.017539262771606445 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1502532958984375 time spend to save output : 0.01827526092529297 total time spend for step 5 : 0.16852855682373047 step6:blur_detection Tue Dec 2 21:55:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722.jpg resize: (2160, 3840) 1397478601 -6.02606395482059 treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1.jpg resize: (2160, 3840) 1397478600 -6.296513090572545 treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe.jpg resize: (2160, 3840) 1397478598 -7.065979665686062 treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad.jpg resize: (2160, 3840) 1397478569 -6.899842093532855 treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492.jpg resize: (2160, 3840) 1397478490 -6.870688752587816 treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f.jpg resize: (2160, 3840) 1397478475 -6.907614949671718 treat image : temp/1764708628_2425465_1397478472_30aa927966e7cd28f13892e81df4fabc.jpg resize: (2160, 3840) 1397478472 -6.403682574268792 treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464.jpg resize: (2160, 3840) 1397478466 -6.546130030091531 treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d.jpg resize: (2160, 3840) 1397478464 -6.641749761937288 treat image : temp/1764708628_2425465_1397478429_9c631a0858f894c7ad092a52ea125ae0.jpg resize: (2160, 3840) 1397478429 -6.707855671407555 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad.jpg resize: (2160, 3840) 1397478205 -7.006024315930102 treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0.jpg resize: (2160, 3840) 1397478114 -7.0448499097477075 treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954.jpg resize: (2160, 3840) 1397478073 -6.311765001303684 treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43.jpg resize: (2160, 3840) 1397478049 -4.289121869608429 treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee.jpg resize: (2160, 3840) 1397478043 -6.397809542837784 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597325_0.png resize: (196, 129) 1397489638 -4.1115818128731965 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597328_0.png resize: (292, 347) 1397489639 -4.428185603466078 treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597333_0.png resize: (127, 318) 1397489640 -4.310769468316769 treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597334_0.png resize: (339, 391) 1397489641 -4.545700520910592 treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597337_0.png resize: (587, 485) 1397489642 -4.999421713322852 treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597338_0.png resize: (253, 226) 1397489643 -4.536599732110919 treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597339_0.png resize: (453, 346) 1397489644 -5.2213259482124394 treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597344_0.png resize: (243, 292) 1397489645 -4.525438754167927 treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597345_0.png resize: (177, 160) 1397489646 -4.2828498754024125 treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597346_0.png resize: (260, 347) 1397489647 -4.204466314474818 treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597349_0.png resize: (264, 395) 1397489648 -3.6910616311225826 treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597352_0.png resize: (229, 262) 1397489649 -3.9751082471622903 treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597354_0.png resize: (171, 209) 1397489650 -3.7405466154260347 treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597355_0.png resize: (364, 320) 1397489651 -5.179488477938177 treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597357_0.png resize: (510, 738) 1397489653 -4.5310811330920195 treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597358_0.png resize: (298, 465) 1397489654 -5.551573453612173 treat image : temp/1764708628_2425465_1397478472_30aa927966e7cd28f13892e81df4fabc_rle_crop_4055597359_0.png resize: (247, 157) 1397489655 -4.064573522126077 treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597362_0.png resize: (202, 225) 1397489656 -4.788169568775779 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597375_0.png resize: (289, 130) 1397489657 -4.467166239763156 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597377_0.png resize: (219, 195) 1397489658 -4.142525328197126 treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597378_0.png resize: (119, 241) 1397489659 -5.048645346608387 treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597380_0.png resize: (312, 454) 1397489660 -4.481999640580997 treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597382_0.png resize: (238, 102) 1397489661 -4.123918242988755 treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597385_0.png resize: (197, 184) 1397489662 -5.107313247149573 treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597386_0.png resize: (175, 197) 1397489663 -2.7955606450739627 treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597391_0.png resize: (327, 380) 1397489664 -4.628752081962041 treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597395_0.png resize: (88, 219) 1397489665 -2.52273128241938 treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597396_0.png resize: (350, 558) 1397489666 -5.063089720811041 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597329_0.png resize: (474, 246) 1397489669 -4.520668272773108 treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597332_0.png resize: (309, 231) 1397489670 -2.93639413576756 treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597343_0.png resize: (109, 301) 1397489671 -4.8278173267555555 treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597348_0.png resize: (640, 304) 1397489672 -5.190101207283166 treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597350_0.png resize: (146, 168) 1397489673 -3.8166070879085527 treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597351_0.png resize: (406, 155) 1397489674 -3.3329207698179024 treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597353_0.png resize: (224, 101) 1397489675 -2.704633891997225 treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597360_0.png resize: (146, 154) 1397489676 -1.5240014530982784 treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597361_0.png resize: (157, 211) 1397489677 -2.233100441254416 treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597363_0.png resize: (142, 145) 1397489678 -2.6132683726037373 treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597367_0.png resize: (129, 188) 1397489679 -4.985811304654641 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597373_0.png resize: (242, 226) 1397489680 -4.9035992281570335 treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597381_0.png resize: (223, 198) 1397489681 -4.847103960140478 treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597392_0.png resize: (248, 493) 1397489682 -2.963378512128383 treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597394_0.png resize: (517, 321) 1397489683 -4.283788126029663 treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597336_0.png resize: (128, 111) 1397489684 -4.594453138863984 treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597340_0.png resize: (251, 202) 1397489685 -4.043629466868812 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597371_0.png resize: (112, 145) 1397489686 -5.362230433713706 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597372_0.png resize: (187, 129) 1397489687 -4.587268070412024 treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597384_0.png resize: (138, 123) 1397489688 -4.037837465241713 treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597388_0.png resize: (160, 119) 1397489689 -4.509452708100868 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597323_0.png resize: (220, 195) 1397489690 -3.77766030822075 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597326_0.png resize: (449, 1039) 1397489691 -5.718493728016561 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597327_0.png resize: (94, 160) 1397489692 -4.040343464045854 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597330_0.png resize: (793, 533) 1397489694 -5.032263173356207 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597331_0.png resize: (371, 336) 1397489695 -5.651076029903555 treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597335_0.png resize: (548, 677) 1397489696 -4.439868454595277 treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597341_0.png resize: (136, 313) 1397489697 -5.372377238764795 treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597342_0.png resize: (267, 201) 1397489698 -5.163126720360194 treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597347_0.png resize: (164, 217) 1397489699 -3.652539766476927 treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597356_0.png resize: (492, 338) 1397489700 -4.003182425649206 treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597366_0.png resize: (133, 117) 1397489701 -3.977471719397252 treat image : temp/1764708628_2425465_1397478429_9c631a0858f894c7ad092a52ea125ae0_rle_crop_4055597369_0.png resize: (179, 158) 1397489702 -4.155706769283056 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597370_0.png resize: (264, 597) 1397489703 -5.660547107244798 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597374_0.png resize: (272, 311) 1397489704 -3.1838316529067026 treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597376_0.png resize: (200, 286) 1397489705 -4.928753448229038 treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597379_0.png resize: (192, 221) 1397489706 -5.610718239242866 treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597383_0.png resize: (388, 160) 1397489707 -5.138430297764123 treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597387_0.png resize: (257, 481) 1397489708 -5.066005454319007 treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597389_0.png resize: (563, 1098) 1397489709 -4.719913545257284 treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597393_0.png resize: (218, 272) 1397489710 -4.5918577189374 treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597397_0.png resize: (92, 118) 1397489711 -3.193194160745433 treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597364_0.png resize: (269, 174) 1397489713 -3.6046813067642374 treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597365_0.png resize: (170, 116) 1397489714 -4.978431074171256 treat image : temp/1764708628_2425465_1397478429_9c631a0858f894c7ad092a52ea125ae0_rle_crop_4055597368_0.png resize: (243, 253) 1397489715 -5.195372150500736 treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597324_0.png resize: (183, 252) 1397489716 -4.92537858272157 treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597390_0.png resize: (415, 181) 1397489717 -4.8931461757942865 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.019419431686401367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.020375728607177734 save missing photos in datou_result : time spend for datou_step_exec : 69.01347255706787 time spend to save output : 0.04673051834106445 total time spend for step 6 : 69.06020307540894 step7:brightness Tue Dec 2 21:56:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722.jpg treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1.jpg treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe.jpg treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad.jpg treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492.jpg treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f.jpg treat image : temp/1764708628_2425465_1397478472_30aa927966e7cd28f13892e81df4fabc.jpg treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464.jpg treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d.jpg treat image : temp/1764708628_2425465_1397478429_9c631a0858f894c7ad092a52ea125ae0.jpg treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad.jpg treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0.jpg treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954.jpg treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43.jpg treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee.jpg treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597325_0.png treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597328_0.png treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597333_0.png treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597334_0.png treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597337_0.png treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597338_0.png treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597339_0.png treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597344_0.png treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597345_0.png treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597346_0.png treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597349_0.png treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597352_0.png treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597354_0.png treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597355_0.png treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597357_0.png treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597358_0.png treat image : temp/1764708628_2425465_1397478472_30aa927966e7cd28f13892e81df4fabc_rle_crop_4055597359_0.png treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597362_0.png treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597375_0.png treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597377_0.png treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597378_0.png treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597380_0.png treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597382_0.png treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597385_0.png treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597386_0.png treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597391_0.png treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597395_0.png treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597396_0.png treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597329_0.png treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597332_0.png treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597343_0.png treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597348_0.png treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597350_0.png treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597351_0.png treat image : temp/1764708628_2425465_1397478490_2418a997001e7dc4a58b4fa27a174492_rle_crop_4055597353_0.png treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597360_0.png treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597361_0.png treat image : temp/1764708628_2425465_1397478466_b1d791ef25cd7c6d5cd9b4d53e389464_rle_crop_4055597363_0.png treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597367_0.png treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597373_0.png treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597381_0.png treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597392_0.png treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597394_0.png treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597336_0.png treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597340_0.png treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597371_0.png treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597372_0.png treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597384_0.png treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597388_0.png treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597323_0.png treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597326_0.png treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597327_0.png treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597330_0.png treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597331_0.png treat image : temp/1764708628_2425465_1397478600_86eabd77f85da453ba8d140825640ff1_rle_crop_4055597335_0.png treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597341_0.png treat image : temp/1764708628_2425465_1397478598_e0c3e25dbf7ed449ff2e5110d303cafe_rle_crop_4055597342_0.png treat image : temp/1764708628_2425465_1397478569_11b068a1180f5284027045cb1f52c4ad_rle_crop_4055597347_0.png treat image : temp/1764708628_2425465_1397478475_59f694bd28fe081d1ae9a32be35a730f_rle_crop_4055597356_0.png treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597366_0.png treat image : temp/1764708628_2425465_1397478429_9c631a0858f894c7ad092a52ea125ae0_rle_crop_4055597369_0.png treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597370_0.png treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597374_0.png treat image : temp/1764708628_2425465_1397478205_8029f8afe8efca49dac219897001caad_rle_crop_4055597376_0.png treat image : temp/1764708628_2425465_1397478114_942d12646959e4ce80cacbf4d8bc69b0_rle_crop_4055597379_0.png treat image : temp/1764708628_2425465_1397478073_990129e279264374751b157b0ba5e954_rle_crop_4055597383_0.png treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597387_0.png treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597389_0.png treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597393_0.png treat image : temp/1764708628_2425465_1397478043_e79d72a2830ed5762b94d031b1b68eee_rle_crop_4055597397_0.png treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597364_0.png treat image : temp/1764708628_2425465_1397478464_7d518e35e438e8d6fb36b0dc8471960d_rle_crop_4055597365_0.png treat image : temp/1764708628_2425465_1397478429_9c631a0858f894c7ad092a52ea125ae0_rle_crop_4055597368_0.png treat image : temp/1764708628_2425465_1397478601_de5e875e39655674598fdc4d62f18722_rle_crop_4055597324_0.png treat image : temp/1764708628_2425465_1397478049_430c2ee60f4cd0fb34072420456d3f43_rle_crop_4055597390_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.022363901138305664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.025539398193359375 save missing photos in datou_result : time spend for datou_step_exec : 14.869338989257812 time spend to save output : 0.05366373062133789 total time spend for step 7 : 14.92300271987915 step8:velours_tree Tue Dec 2 21:56:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3524298667907715 time spend to save output : 4.673004150390625e-05 total time spend for step 8 : 0.3524765968322754 step9:send_mail_cod Tue Dec 2 21:56:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29112007_02-12-2025_21_56_26.pdf 29112692 imagette291126921764708986 29112693 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette291126931764708986 29112695 imagette291126951764708987 29112696 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette291126961764708987 29112697 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette291126971764708989 29112698 imagette291126981764708991 29112699 change filename to text .change filename to text .imagette291126991764708991 29112700 change filename to text .change filename to text .change filename to text .imagette291127001764708991 29112701 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette291127011764708991 29112702 imagette291127021764708993 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29112007 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29112692,29112693,29112694,29112695,29112696,29112697,29112698,29112699,29112700,29112701,29112702?tags=flou,metal,environnement,pehd,papier,pet_clair,mal_croppe,pet_fonce,autre,carton,background your option no_mail is active, we will not send the real mail to your client args[1397478601] : ((1397478601, -6.02606395482059, 492609224), (1397478601, -0.9615241336437949, 501862349), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478600] : ((1397478600, -6.296513090572545, 492609224), (1397478600, -0.4275182838075324, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478598] : ((1397478598, -7.065979665686062, 492609224), (1397478598, -0.3332523386507717, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478569] : ((1397478569, -6.899842093532855, 492609224), (1397478569, -0.3383646186211635, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478490] : ((1397478490, -6.870688752587816, 492609224), (1397478490, -0.34222510610531426, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478475] : ((1397478475, -6.907614949671718, 492609224), (1397478475, -0.28189150387888434, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478472] : ((1397478472, -6.403682574268792, 492609224), (1397478472, -0.37657009456307955, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478466] : ((1397478466, -6.546130030091531, 492609224), (1397478466, -0.5345296741595295, 501862349), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478464] : ((1397478464, -6.641749761937288, 492609224), (1397478464, -0.5316215215294967, 501862349), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478429] : ((1397478429, -6.707855671407555, 492609224), (1397478429, -0.3195423978433047, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478205] : ((1397478205, -7.006024315930102, 492609224), (1397478205, -0.23963313524923813, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478114] : ((1397478114, -7.0448499097477075, 492609224), (1397478114, -0.26564376762751457, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478073] : ((1397478073, -6.311765001303684, 492609224), (1397478073, -0.6761004842349684, 501862349), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478049] : ((1397478049, -4.289121869608429, 492609224), (1397478049, -1.661839446679018, 501862349), '0.03646474729938272') We are sending mail with results at report@fotonower.com args[1397478043] : ((1397478043, -6.397809542837784, 492609224), (1397478043, -0.411044044545987, 496442774), '0.03646474729938272') We are sending mail with results at report@fotonower.com refus_total : 0.03646474729938272 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29112007 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29112007_02-12-2025_21_56_26.pdf results_Auto_P29112007_02-12-2025_21_56_26.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29112007_02-12-2025_21_56_26.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29112007','results_Auto_P29112007_02-12-2025_21_56_26.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29112007_02-12-2025_21_56_26.pdf','pdf','','0.94','0.03646474729938272') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1397478601, 1397478600, 1397478598, 1397478569, 1397478490, 1397478475, 1397478472, 1397478466, 1397478464, 1397478429, 1397478205, 1397478114, 1397478073, 1397478049, 1397478043] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478601', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478600', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478598', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478569', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478490', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478475', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478472', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478466', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478464', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478429', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478205', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478114', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478073', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478049', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478043', None, None, None, None, None, '4175967') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.018824100494384766 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.967836380004883 time spend to save output : 0.01912856101989746 total time spend for step 9 : 10.98696494102478 step10:split_time_score Tue Dec 2 21:56:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 15),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02122025 29112007 Nombre de photos uploadées : 15 / 23040 (0%) 02122025 29112007 Nombre de photos taguées (types de déchets): 0 / 15 (0%) 02122025 29112007 Nombre de photos taguées (volume) : 0 / 15 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ??????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005879402160644531 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.25779199600219727 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03496575199331276 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29081012_02-12-2025_09_56_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29081012 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29081012 AND mptpi.`type`=3594 To do Qualite : 0.01587891966580668 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29081033_02-12-2025_12_14_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29081033 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29081033 AND mptpi.`type`=3726 To do Qualite : 0.19471505803333528 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29081038_02-12-2025_12_11_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29081038 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29081038 AND mptpi.`type`=3726 To do Qualite : 0.009541617616756596 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29081075_02-12-2025_12_02_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29081075 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29081075 AND mptpi.`type`=3726 To do Qualite : 0.009897827252991062 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29101449_02-12-2025_17_22_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29101449 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29101449 AND mptpi.`type`=3726 To do Qualite : 0.040899357385126345 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29097631_02-12-2025_15_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29097631 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29097631 AND mptpi.`type`=3726 To do Qualite : 0.01237640898762042 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29094679_02-12-2025_16_06_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29094679 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29094679 AND mptpi.`type`=3726 To do Qualite : 0.022038443798372324 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29101467_02-12-2025_17_14_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29101467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29101467 AND mptpi.`type`=3726 To do Qualite : 0.03752444494762223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29109855_02-12-2025_20_36_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29109855 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29109855 AND mptpi.`type`=3726 To do Qualite : 0.07868969938027151 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29105983_02-12-2025_19_14_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29105983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29105983 AND mptpi.`type`=3726 To do Qualite : 0.030813944460500797 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29108924_02-12-2025_20_20_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29108924 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29108924 AND mptpi.`type`=3726 To do Qualite : 0.03646474729938272 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29112007_02-12-2025_21_56_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29112007 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29112007 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02122025': {'nb_upload': 15, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1397478601, 1397478600, 1397478598, 1397478569, 1397478490, 1397478475, 1397478472, 1397478466, 1397478464, 1397478429, 1397478205, 1397478114, 1397478073, 1397478049, 1397478043] Looping around the photos to save general results len do output : 1 /29112007Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478601', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478600', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478598', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478569', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478490', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478475', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478472', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478466', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478464', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478429', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478205', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478114', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478073', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478049', None, None, None, None, None, '4175967') ('3318', None, None, None, None, None, None, None, '4175967') ('3318', '29112007', '1397478043', None, None, None, None, None, '4175967') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.021029949188232422 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.394620418548584 time spend to save output : 0.021290302276611328 total time spend for step 10 : 1.4159107208251953 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 15 set_done_treatment 147.51user 185.38system 6:15.24elapsed 88%CPU (0avgtext+0avgdata 4350856maxresident)k 2507920inputs+128520outputs (30591major+13740538minor)pagefaults 0swaps