python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3549798 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4030164'] with mtr_portfolio_ids : ['28415993'] and first list_photo_ids : [] new path : /proc/3549798/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 17 ; length of list_pids : 17 ; length of list_args : 17 time to download the photos : 2.457303524017334 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Nov 11 00:40:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3366 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-11 00:40:32.894083: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-11 00:40:32.922496: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-11 00:40:32.924628: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f511c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-11 00:40:32.924692: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-11 00:40:32.928993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-11 00:40:33.152273: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x14e5a220 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-11 00:40:33.152328: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-11 00:40:33.157051: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-11 00:40:33.157996: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-11 00:40:33.162655: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-11 00:40:33.177112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-11 00:40:33.178166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-11 00:40:33.184130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-11 00:40:33.185496: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-11 00:40:33.198419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-11 00:40:33.199732: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-11 00:40:33.199819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-11 00:40:33.200512: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-11 00:40:33.200531: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-11 00:40:33.200543: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-11 00:40:33.201835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2914 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-11 00:40:33.524742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-11 00:40:33.524875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-11 00:40:33.524895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-11 00:40:33.524912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-11 00:40:33.524927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-11 00:40:33.524943: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-11 00:40:33.524958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-11 00:40:33.524974: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-11 00:40:33.525785: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-11 00:40:33.526983: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-11 00:40:33.527020: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-11 00:40:33.527038: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-11 00:40:33.527052: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-11 00:40:33.527065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-11 00:40:33.527079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-11 00:40:33.527093: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-11 00:40:33.527107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-11 00:40:33.527925: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-11 00:40:33.527966: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-11 00:40:33.527974: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-11 00:40:33.527981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-11 00:40:33.528811: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2914 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-11 00:40:41.560120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-11 00:40:41.729315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-11 00:40:43.507323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.507954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.11G (2268581120 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.507976: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.508617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.508633: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.515685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.515707: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.516306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.516323: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.522857: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.522881: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.523485: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.523502: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.554081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.554119: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.554692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.554708: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.560494: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.560513: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.561062: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.561077: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-11 00:40:43.594654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.595222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.597067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.597622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.641314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.641886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.644078: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.644630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.674783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.675410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.677118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.677704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.685408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.685993: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.687894: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.688464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.695432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.696069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.697769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.698355: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.726622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.727203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.727836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.728399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.732316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.732880: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.748371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.748938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.749496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.750053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.762257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.762870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.763455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.764011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.768312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.769015: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.773643: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.774205: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.786575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.787140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.791350: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.791961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.792541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.793096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.793826: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.794413: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.804985: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.805551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.806126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.806732: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.807337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.807897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.822932: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.823534: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.871947: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.872553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.873123: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.873678: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.881407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.881977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.902584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.903378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.904143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.904895: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.909311: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.910103: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.910887: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.911592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.913100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.913117: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-11-11 00:40:43.922920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.923544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.932710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.933425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.934023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.934632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.935259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-11 00:40:43.935864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.35G (2520645632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 3550286 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2173 tf kernel not reseted sub process len(results) : 17 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 17 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3366 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 13973 time to create 1 rle with old method : 0.017548084259033203 length of segment : 125 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 8163 time to create 1 rle with old method : 0.009105682373046875 length of segment : 146 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 3677 time to create 1 rle with old method : 0.004029512405395508 length of segment : 56 time for calcul the mask position with numpy : 0.00018715858459472656 nb_pixel_total : 9940 time to create 1 rle with old method : 0.010960578918457031 length of segment : 108 time for calcul the mask position with numpy : 0.00016188621520996094 nb_pixel_total : 10108 time to create 1 rle with old method : 0.01131439208984375 length of segment : 88 time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 20758 time to create 1 rle with old method : 0.022485017776489258 length of segment : 236 time for calcul the mask position with numpy : 0.011119842529296875 nb_pixel_total : 722804 time to create 1 rle with new method : 0.04212069511413574 length of segment : 990 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 3925 time to create 1 rle with old method : 0.00438690185546875 length of segment : 84 time for calcul the mask position with numpy : 0.0014524459838867188 nb_pixel_total : 103521 time to create 1 rle with old method : 0.10713672637939453 length of segment : 530 time for calcul the mask position with numpy : 0.00018072128295898438 nb_pixel_total : 10056 time to create 1 rle with old method : 0.011358499526977539 length of segment : 100 time for calcul the mask position with numpy : 0.0002522468566894531 nb_pixel_total : 10003 time to create 1 rle with old method : 0.012626886367797852 length of segment : 87 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 10502 time to create 1 rle with old method : 0.012073755264282227 length of segment : 90 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 5010 time to create 1 rle with old method : 0.005929470062255859 length of segment : 79 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 3811 time to create 1 rle with old method : 0.004491567611694336 length of segment : 125 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 3150 time to create 1 rle with old method : 0.0038459300994873047 length of segment : 60 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 17286 time to create 1 rle with old method : 0.01943516731262207 length of segment : 160 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 10327 time to create 1 rle with old method : 0.01143026351928711 length of segment : 133 time for calcul the mask position with numpy : 0.00018095970153808594 nb_pixel_total : 15008 time to create 1 rle with old method : 0.015861034393310547 length of segment : 154 time for calcul the mask position with numpy : 0.0001671314239501953 nb_pixel_total : 11606 time to create 1 rle with old method : 0.012281179428100586 length of segment : 144 time for calcul the mask position with numpy : 0.00017762184143066406 nb_pixel_total : 12279 time to create 1 rle with old method : 0.01365041732788086 length of segment : 94 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 6426 time to create 1 rle with old method : 0.00761866569519043 length of segment : 121 time for calcul the mask position with numpy : 0.0012493133544921875 nb_pixel_total : 85690 time to create 1 rle with old method : 0.09274029731750488 length of segment : 478 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 28919 time to create 1 rle with old method : 0.029782772064208984 length of segment : 252 time for calcul the mask position with numpy : 0.0002090930938720703 nb_pixel_total : 14475 time to create 1 rle with old method : 0.01978468894958496 length of segment : 176 time for calcul the mask position with numpy : 0.00033783912658691406 nb_pixel_total : 16261 time to create 1 rle with old method : 0.017627954483032227 length of segment : 107 time for calcul the mask position with numpy : 0.0002880096435546875 nb_pixel_total : 8141 time to create 1 rle with old method : 0.008826971054077148 length of segment : 98 time for calcul the mask position with numpy : 0.0003733634948730469 nb_pixel_total : 16184 time to create 1 rle with old method : 0.017083168029785156 length of segment : 149 time for calcul the mask position with numpy : 0.0026848316192626953 nb_pixel_total : 102459 time to create 1 rle with old method : 0.10821890830993652 length of segment : 597 time for calcul the mask position with numpy : 0.00040149688720703125 nb_pixel_total : 17712 time to create 1 rle with old method : 0.019186973571777344 length of segment : 124 time for calcul the mask position with numpy : 0.0003452301025390625 nb_pixel_total : 10902 time to create 1 rle with old method : 0.011531352996826172 length of segment : 150 time for calcul the mask position with numpy : 0.0006186962127685547 nb_pixel_total : 26411 time to create 1 rle with old method : 0.0277099609375 length of segment : 211 time for calcul the mask position with numpy : 0.001953125 nb_pixel_total : 91721 time to create 1 rle with old method : 0.09712505340576172 length of segment : 508 time for calcul the mask position with numpy : 0.00030040740966796875 nb_pixel_total : 10717 time to create 1 rle with old method : 0.012724161148071289 length of segment : 95 time for calcul the mask position with numpy : 0.0004470348358154297 nb_pixel_total : 9053 time to create 1 rle with old method : 0.015190839767456055 length of segment : 140 time for calcul the mask position with numpy : 0.00025272369384765625 nb_pixel_total : 6569 time to create 1 rle with old method : 0.0075228214263916016 length of segment : 90 time for calcul the mask position with numpy : 0.0002894401550292969 nb_pixel_total : 8009 time to create 1 rle with old method : 0.009313821792602539 length of segment : 128 time for calcul the mask position with numpy : 0.0004868507385253906 nb_pixel_total : 10386 time to create 1 rle with old method : 0.012133359909057617 length of segment : 184 time spent for convertir_results : 1.9777226448059082 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 37 chid ids of type : 3594 Number RLEs to save : 7197 save missing photos in datou_result : time spend for datou_step_exec : 25.2986798286438 time spend to save output : 0.5129754543304443 total time spend for step 1 : 25.811655282974243 step2:crop_condition Tue Nov 11 00:40:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 17 ! batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762818056_3549798 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763284_2e4ff3689ac60d81b7f09953fce42836_rle_crop_4030116411_0.png', 0, 95, 54, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763282_c7ccc1cfa376884ae66238fd22313d56_rle_crop_4030116413_0.png', 0, 133, 88, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116416_0.png', 0, 65, 84, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763211_ff95b90a6ff6dbb25ec4b6acd4ca11c1_rle_crop_4030116419_0.png', 0, 136, 86, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116422_0.png', 0, 42, 125, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763192_30ee11a0669e32e08b1dca807ace7f83_rle_crop_4030116429_0.png', 0, 62, 119, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116434_0.png', 0, 136, 98, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116444_0.png', 0, 80, 128, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116443_0.png', 0, 108, 90, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818058), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116445_0.png', 0, 134, 180, 0, 1762818058,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3490207195281982 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762818059_3549798 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818060), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763286_6a0f6a6bced83a7dd2840bd7cd9dc9d4_rle_crop_4030116409_0.png', 0, 149, 121, 0, 1762818060,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818060), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763282_c7ccc1cfa376884ae66238fd22313d56_rle_crop_4030116412_0.png', 0, 180, 108, 0, 1762818060,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818060), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116420_0.png', 0, 141, 90, 0, 1762818060,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818060), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763205_db5349d35d738c8651a3d802ae235e4b_rle_crop_4030116427_0.png', 0, 103, 143, 0, 1762818060,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818060), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763192_30ee11a0669e32e08b1dca807ace7f83_rle_crop_4030116428_0.png', 0, 166, 94, 0, 1762818060,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818060), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116435_0.png', 0, 155, 148, 0, 1762818060,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818060), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116441_0.png', 0, 142, 93, 0, 1762818060,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7547671794891357 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762818066_3549798 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763286_6a0f6a6bced83a7dd2840bd7cd9dc9d4_rle_crop_4030116410_0.png', 0, 118, 93, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763279_5d84b1b96ac6d5ff02e129b084195772_rle_crop_4030116415_0.png', 0, 964, 983, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763279_5d84b1b96ac6d5ff02e129b084195772_rle_crop_4030116414_0.png', 0, 146, 236, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116418_0.png', 0, 130, 98, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116417_0.png', 0, 329, 528, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116423_0.png', 0, 70, 60, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116425_0.png', 0, 113, 133, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116426_0.png', 0, 123, 154, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116424_0.png', 0, 159, 141, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763191_9bb2822e564c362859d9b600dfc52d1b_rle_crop_4030116430_0.png', 0, 327, 462, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763188_8c1a1ed0bf4d2704b12deb171acc00bf_rle_crop_4030116431_0.png', 0, 163, 252, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116432_0.png', 0, 102, 173, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116433_0.png', 0, 186, 106, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116436_0.png', 0, 334, 527, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763085_35ef64d157ad9bee5bde5c2fa0293916_rle_crop_4030116438_0.png', 0, 89, 149, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763085_35ef64d157ad9bee5bde5c2fa0293916_rle_crop_4030116437_0.png', 0, 169, 120, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763044_a56bc3191d449cbcaf74226f3d6a4bdb_rle_crop_4030116439_0.png', 0, 185, 206, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763044_a56bc3191d449cbcaf74226f3d6a4bdb_rle_crop_4030116440_0.png', 0, 328, 504, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818070), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116442_0.png', 0, 105, 140, 0, 1762818070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.908087968826294 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762818072_3549798 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762818072), 0.0, 0.0, 14, '', 0, 0, '1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116421_0.png', 0, 88, 79, 0, 1762818072,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6106493473052979 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1393763286, 1393763284, 1393763282, 1393763279, 1393763276, 1393763211, 1393763210, 1393763205, 1393763192, 1393763191, 1393763188, 1393763152, 1393763120, 1393763085, 1393763044, 1393763015, 1393763001] Looping around the photos to save general results len do output : 37 /1393842637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393842678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763286', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763284', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763282', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763279', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763276', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763211', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763210', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763205', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763192', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763191', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763188', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763152', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763120', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763085', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763044', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763015', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763001', None, None, None, None, None, '4030164') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 128 time used for this insertion : 0.026472091674804688 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.200256824493408 time spend to save output : 0.02787327766418457 total time spend for step 2 : 17.228130102157593 step3:rle_unique_nms_with_priority Tue Nov 11 00:41:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.22537970542907715 time for calcul the mask position with numpy : 0.22378969192504883 nb_pixel_total : 2051464 time to create 1 rle with new method : 0.245957612991333 time for calcul the mask position with numpy : 0.006166219711303711 nb_pixel_total : 8163 time to create 1 rle with old method : 0.008572101593017578 time for calcul the mask position with numpy : 0.006089925765991211 nb_pixel_total : 13973 time to create 1 rle with old method : 0.014487981796264648 create new chi : 0.514430046081543 time to delete rle : 0.02808094024658203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1622 TO DO : save crop sub photo not yet done ! save time : 0.14859819412231445 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.29196977615356445 time for calcul the mask position with numpy : 0.04050469398498535 nb_pixel_total : 2069923 time to create 1 rle with new method : 0.07183504104614258 time for calcul the mask position with numpy : 0.006085395812988281 nb_pixel_total : 3677 time to create 1 rle with old method : 0.003872394561767578 create new chi : 0.12840056419372559 time to delete rle : 0.00019788742065429688 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1192 TO DO : save crop sub photo not yet done ! save time : 0.11000251770019531 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04480934143066406 time for calcul the mask position with numpy : 0.18331480026245117 nb_pixel_total : 2053552 time to create 1 rle with new method : 0.16642069816589355 time for calcul the mask position with numpy : 0.005999565124511719 nb_pixel_total : 10108 time to create 1 rle with old method : 0.010865211486816406 time for calcul the mask position with numpy : 0.0059661865234375 nb_pixel_total : 9940 time to create 1 rle with old method : 0.010627985000610352 create new chi : 0.392686128616333 time to delete rle : 0.0002472400665283203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1472 TO DO : save crop sub photo not yet done ! save time : 0.12874531745910645 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.048666954040527344 time for calcul the mask position with numpy : 0.04228854179382324 nb_pixel_total : 1330038 time to create 1 rle with new method : 0.14387989044189453 time for calcul the mask position with numpy : 0.010829687118530273 nb_pixel_total : 722804 time to create 1 rle with new method : 0.1439836025238037 time for calcul the mask position with numpy : 0.009994029998779297 nb_pixel_total : 20758 time to create 1 rle with old method : 0.02257847785949707 create new chi : 0.38097620010375977 time to delete rle : 0.0004851818084716797 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3532 TO DO : save crop sub photo not yet done ! save time : 0.26652979850769043 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.27631044387817383 time for calcul the mask position with numpy : 0.11763405799865723 nb_pixel_total : 1956098 time to create 1 rle with new method : 0.07721686363220215 time for calcul the mask position with numpy : 0.005978107452392578 nb_pixel_total : 10056 time to create 1 rle with old method : 0.010545730590820312 time for calcul the mask position with numpy : 0.006821393966674805 nb_pixel_total : 103521 time to create 1 rle with old method : 0.109222412109375 time for calcul the mask position with numpy : 0.005927085876464844 nb_pixel_total : 3925 time to create 1 rle with old method : 0.00416874885559082 create new chi : 0.347606897354126 time to delete rle : 0.0003879070281982422 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2508 TO DO : save crop sub photo not yet done ! save time : 0.2085871696472168 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.047164201736450195 time for calcul the mask position with numpy : 0.018907546997070312 nb_pixel_total : 2063597 time to create 1 rle with new method : 0.20166873931884766 time for calcul the mask position with numpy : 0.006618976593017578 nb_pixel_total : 10003 time to create 1 rle with old method : 0.015769004821777344 create new chi : 0.2513008117675781 time to delete rle : 0.00021505355834960938 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1254 TO DO : save crop sub photo not yet done ! save time : 0.11873221397399902 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 0.4192345142364502 time for calcul the mask position with numpy : 0.14705157279968262 nb_pixel_total : 2008506 time to create 1 rle with new method : 0.07676386833190918 time for calcul the mask position with numpy : 0.00602412223815918 nb_pixel_total : 15008 time to create 1 rle with old method : 0.016629695892333984 time for calcul the mask position with numpy : 0.006295680999755859 nb_pixel_total : 10327 time to create 1 rle with old method : 0.011264801025390625 time for calcul the mask position with numpy : 0.006148099899291992 nb_pixel_total : 17286 time to create 1 rle with old method : 0.01881551742553711 time for calcul the mask position with numpy : 0.00629115104675293 nb_pixel_total : 3150 time to create 1 rle with old method : 0.0036339759826660156 time for calcul the mask position with numpy : 0.006331682205200195 nb_pixel_total : 3811 time to create 1 rle with old method : 0.004405498504638672 time for calcul the mask position with numpy : 0.006371498107910156 nb_pixel_total : 5010 time to create 1 rle with old method : 0.005789518356323242 time for calcul the mask position with numpy : 0.0063016414642333984 nb_pixel_total : 10502 time to create 1 rle with old method : 0.011715412139892578 create new chi : 0.34973978996276855 time to delete rle : 0.0004172325134277344 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 2682 TO DO : save crop sub photo not yet done ! save time : 0.23771214485168457 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.033998966217041016 time for calcul the mask position with numpy : 0.02069401741027832 nb_pixel_total : 2061994 time to create 1 rle with new method : 0.029874801635742188 time for calcul the mask position with numpy : 0.00612640380859375 nb_pixel_total : 11606 time to create 1 rle with old method : 0.013126850128173828 create new chi : 0.07005786895751953 time to delete rle : 0.00021958351135253906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1368 TO DO : save crop sub photo not yet done ! save time : 0.12351727485656738 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.042635202407836914 time for calcul the mask position with numpy : 0.020682096481323242 nb_pixel_total : 2054895 time to create 1 rle with new method : 0.02962803840637207 time for calcul the mask position with numpy : 0.005995273590087891 nb_pixel_total : 6426 time to create 1 rle with old method : 0.007395505905151367 time for calcul the mask position with numpy : 0.006062030792236328 nb_pixel_total : 12279 time to create 1 rle with old method : 0.013784408569335938 create new chi : 0.08379030227661133 time to delete rle : 0.00028705596923828125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1510 TO DO : save crop sub photo not yet done ! save time : 0.14353036880493164 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04664802551269531 time for calcul the mask position with numpy : 0.059233903884887695 nb_pixel_total : 1987910 time to create 1 rle with new method : 0.23125529289245605 time for calcul the mask position with numpy : 0.006265878677368164 nb_pixel_total : 85690 time to create 1 rle with old method : 0.09122729301452637 create new chi : 0.3979218006134033 time to delete rle : 0.00030684471130371094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2036 TO DO : save crop sub photo not yet done ! save time : 0.16957688331604004 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.033288002014160156 time for calcul the mask position with numpy : 0.14086413383483887 nb_pixel_total : 2044681 time to create 1 rle with new method : 0.0839695930480957 time for calcul the mask position with numpy : 0.005899667739868164 nb_pixel_total : 28919 time to create 1 rle with old method : 0.029547691345214844 create new chi : 0.2702653408050537 time to delete rle : 0.00038433074951171875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1584 TO DO : save crop sub photo not yet done ! save time : 0.15654850006103516 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.33171892166137695 time for calcul the mask position with numpy : 0.1448068618774414 nb_pixel_total : 1916080 time to create 1 rle with new method : 0.08479762077331543 time for calcul the mask position with numpy : 0.007170915603637695 nb_pixel_total : 102459 time to create 1 rle with old method : 0.11665749549865723 time for calcul the mask position with numpy : 0.0066585540771484375 nb_pixel_total : 16184 time to create 1 rle with old method : 0.026259422302246094 time for calcul the mask position with numpy : 0.006609439849853516 nb_pixel_total : 8141 time to create 1 rle with old method : 0.013212442398071289 time for calcul the mask position with numpy : 0.006722688674926758 nb_pixel_total : 16261 time to create 1 rle with old method : 0.022733688354492188 time for calcul the mask position with numpy : 0.00627589225769043 nb_pixel_total : 14475 time to create 1 rle with old method : 0.01617741584777832 create new chi : 0.46877336502075195 time to delete rle : 0.00048160552978515625 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3334 TO DO : save crop sub photo not yet done ! save time : 0.23747825622558594 No data in photo_id : 1393763120 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.042293548583984375 time for calcul the mask position with numpy : 0.018567800521850586 nb_pixel_total : 2044986 time to create 1 rle with new method : 0.03209114074707031 time for calcul the mask position with numpy : 0.005889177322387695 nb_pixel_total : 10902 time to create 1 rle with old method : 0.011489629745483398 time for calcul the mask position with numpy : 0.00573277473449707 nb_pixel_total : 17712 time to create 1 rle with old method : 0.018626689910888672 create new chi : 0.09265613555908203 time to delete rle : 0.0002608299255371094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1628 TO DO : save crop sub photo not yet done ! save time : 0.1476891040802002 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04417729377746582 time for calcul the mask position with numpy : 0.019052505493164062 nb_pixel_total : 1955468 time to create 1 rle with new method : 0.12578129768371582 time for calcul the mask position with numpy : 0.00635528564453125 nb_pixel_total : 91721 time to create 1 rle with old method : 0.09613513946533203 time for calcul the mask position with numpy : 0.0061419010162353516 nb_pixel_total : 26411 time to create 1 rle with old method : 0.02775406837463379 create new chi : 0.28836584091186523 time to delete rle : 0.0003859996795654297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2518 TO DO : save crop sub photo not yet done ! save time : 0.20236563682556152 No data in photo_id : 1393763015 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.26383543014526367 time for calcul the mask position with numpy : 0.05981588363647461 nb_pixel_total : 2028866 time to create 1 rle with new method : 0.1533033847808838 time for calcul the mask position with numpy : 0.005833625793457031 nb_pixel_total : 10386 time to create 1 rle with old method : 0.010990142822265625 time for calcul the mask position with numpy : 0.0060803890228271484 nb_pixel_total : 8009 time to create 1 rle with old method : 0.008501529693603516 time for calcul the mask position with numpy : 0.005754709243774414 nb_pixel_total : 6569 time to create 1 rle with old method : 0.007036685943603516 time for calcul the mask position with numpy : 0.005788087844848633 nb_pixel_total : 9053 time to create 1 rle with old method : 0.009877204895019531 time for calcul the mask position with numpy : 0.00572967529296875 nb_pixel_total : 10717 time to create 1 rle with old method : 0.011419057846069336 create new chi : 0.3005249500274658 time to delete rle : 0.00038743019104003906 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2354 TO DO : save crop sub photo not yet done ! save time : 0.19048190116882324 map_output_result : {1393763286: (0.0, 'Should be the crop_list due to order', 0), 1393763284: (0.0, 'Should be the crop_list due to order', 0), 1393763282: (0.0, 'Should be the crop_list due to order', 0), 1393763279: (0.0, 'Should be the crop_list due to order', 0), 1393763276: (0.0, 'Should be the crop_list due to order', 0), 1393763211: (0.0, 'Should be the crop_list due to order', 0), 1393763210: (0.0, 'Should be the crop_list due to order', 0), 1393763205: (0.0, 'Should be the crop_list due to order', 0), 1393763192: (0.0, 'Should be the crop_list due to order', 0), 1393763191: (0.0, 'Should be the crop_list due to order', 0), 1393763188: (0.0, 'Should be the crop_list due to order', 0), 1393763152: (0.0, 'Should be the crop_list due to order', 0), 1393763120: (0.0, 'Should be the crop_list due to order', 0.0), 1393763085: (0.0, 'Should be the crop_list due to order', 0), 1393763044: (0.0, 'Should be the crop_list due to order', 0), 1393763015: (0.0, 'Should be the crop_list due to order', 0.0), 1393763001: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1393763286, 1393763284, 1393763282, 1393763279, 1393763276, 1393763211, 1393763210, 1393763205, 1393763192, 1393763191, 1393763188, 1393763152, 1393763120, 1393763085, 1393763044, 1393763015, 1393763001] Looping around the photos to save general results len do output : 17 /1393763286.Didn't retrieve data . /1393763284.Didn't retrieve data . /1393763282.Didn't retrieve data . /1393763279.Didn't retrieve data . /1393763276.Didn't retrieve data . /1393763211.Didn't retrieve data . /1393763210.Didn't retrieve data . /1393763205.Didn't retrieve data . /1393763192.Didn't retrieve data . /1393763191.Didn't retrieve data . /1393763188.Didn't retrieve data . /1393763152.Didn't retrieve data . /1393763120.Didn't retrieve data . /1393763085.Didn't retrieve data . /1393763044.Didn't retrieve data . /1393763015.Didn't retrieve data . /1393763001.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763286', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763284', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763282', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763279', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763276', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763211', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763210', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763205', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763192', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763191', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763188', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763152', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763120', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763085', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763044', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763015', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763001', None, None, None, None, None, '4030164') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.01705145835876465 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.65131425857544 time spend to save output : 0.01760244369506836 total time spend for step 3 : 9.668916702270508 step4:ventilate_hashtags_in_portfolio Tue Nov 11 00:41:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28415993 get user id for portfolio 28415993 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28415993 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','carton','environnement','autre','pehd','pet_fonce','flou','background','metal','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28415993 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','carton','environnement','autre','pehd','pet_fonce','flou','background','metal','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28415993 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','carton','environnement','autre','pehd','pet_fonce','flou','background','metal','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28416311,28416312,28416313,28416314,28416315,28416316,28416317,28416318,28416319,28416320,28416321?tags=mal_croppe,papier,carton,environnement,autre,pehd,pet_fonce,flou,background,metal,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1393763286, 1393763284, 1393763282, 1393763279, 1393763276, 1393763211, 1393763210, 1393763205, 1393763192, 1393763191, 1393763188, 1393763152, 1393763120, 1393763085, 1393763044, 1393763015, 1393763001] Looping around the photos to save general results len do output : 1 /28415993. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763286', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763284', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763282', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763279', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763276', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763211', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763210', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763205', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763192', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763191', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763188', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763152', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763120', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763085', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763044', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763015', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763001', None, None, None, None, None, '4030164') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.015651941299438477 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.634599208831787 time spend to save output : 0.01598191261291504 total time spend for step 4 : 1.6505811214447021 step5:final Tue Nov 11 00:41:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1393763286: ('0.04186926969862018',), 1393763284: ('0.04186926969862018',), 1393763282: ('0.04186926969862018',), 1393763279: ('0.04186926969862018',), 1393763276: ('0.04186926969862018',), 1393763211: ('0.04186926969862018',), 1393763210: ('0.04186926969862018',), 1393763205: ('0.04186926969862018',), 1393763192: ('0.04186926969862018',), 1393763191: ('0.04186926969862018',), 1393763188: ('0.04186926969862018',), 1393763152: ('0.04186926969862018',), 1393763120: ('0.04186926969862018',), 1393763085: ('0.04186926969862018',), 1393763044: ('0.04186926969862018',), 1393763015: ('0.04186926969862018',), 1393763001: ('0.04186926969862018',)} new output for save of step final : {1393763286: ('0.04186926969862018',), 1393763284: ('0.04186926969862018',), 1393763282: ('0.04186926969862018',), 1393763279: ('0.04186926969862018',), 1393763276: ('0.04186926969862018',), 1393763211: ('0.04186926969862018',), 1393763210: ('0.04186926969862018',), 1393763205: ('0.04186926969862018',), 1393763192: ('0.04186926969862018',), 1393763191: ('0.04186926969862018',), 1393763188: ('0.04186926969862018',), 1393763152: ('0.04186926969862018',), 1393763120: ('0.04186926969862018',), 1393763085: ('0.04186926969862018',), 1393763044: ('0.04186926969862018',), 1393763015: ('0.04186926969862018',), 1393763001: ('0.04186926969862018',)} [1393763286, 1393763284, 1393763282, 1393763279, 1393763276, 1393763211, 1393763210, 1393763205, 1393763192, 1393763191, 1393763188, 1393763152, 1393763120, 1393763085, 1393763044, 1393763015, 1393763001] Looping around the photos to save general results len do output : 17 /1393763286.Didn't retrieve data . /1393763284.Didn't retrieve data . /1393763282.Didn't retrieve data . /1393763279.Didn't retrieve data . /1393763276.Didn't retrieve data . /1393763211.Didn't retrieve data . /1393763210.Didn't retrieve data . /1393763205.Didn't retrieve data . /1393763192.Didn't retrieve data . /1393763191.Didn't retrieve data . /1393763188.Didn't retrieve data . /1393763152.Didn't retrieve data . /1393763120.Didn't retrieve data . /1393763085.Didn't retrieve data . /1393763044.Didn't retrieve data . /1393763015.Didn't retrieve data . /1393763001.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763286', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763284', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763282', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763279', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763276', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763211', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763210', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763205', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763192', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763191', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763188', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763152', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763120', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763085', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763044', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763015', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763001', None, None, None, None, None, '4030164') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.014483213424682617 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11308813095092773 time spend to save output : 0.01529550552368164 total time spend for step 5 : 0.12838363647460938 step6:blur_detection Tue Nov 11 00:41:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1762818027_3549798_1393763286_6a0f6a6bced83a7dd2840bd7cd9dc9d4.jpg resize: (1080, 1920) 1393763286 -1.6699448830544663 treat image : temp/1762818027_3549798_1393763284_2e4ff3689ac60d81b7f09953fce42836.jpg resize: (1080, 1920) 1393763284 -1.5744119953370426 treat image : temp/1762818027_3549798_1393763282_c7ccc1cfa376884ae66238fd22313d56.jpg resize: (1080, 1920) 1393763282 -1.8698849932897885 treat image : temp/1762818027_3549798_1393763279_5d84b1b96ac6d5ff02e129b084195772.jpg resize: (1080, 1920) 1393763279 -1.4026513870689923 treat image : temp/1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1.jpg resize: (1080, 1920) 1393763276 -2.135093270809224 treat image : temp/1762818027_3549798_1393763211_ff95b90a6ff6dbb25ec4b6acd4ca11c1.jpg resize: (1080, 1920) 1393763211 -1.4470460223850807 treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6.jpg resize: (1080, 1920) 1393763210 -2.485645888129919 treat image : temp/1762818027_3549798_1393763205_db5349d35d738c8651a3d802ae235e4b.jpg resize: (1080, 1920) 1393763205 -1.2924484258642186 treat image : temp/1762818027_3549798_1393763192_30ee11a0669e32e08b1dca807ace7f83.jpg resize: (1080, 1920) 1393763192 -1.1072950906124046 treat image : temp/1762818027_3549798_1393763191_9bb2822e564c362859d9b600dfc52d1b.jpg resize: (1080, 1920) 1393763191 -0.7253322465411395 treat image : temp/1762818027_3549798_1393763188_8c1a1ed0bf4d2704b12deb171acc00bf.jpg resize: (1080, 1920) 1393763188 -1.1673600933577588 treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a.jpg resize: (1080, 1920) 1393763152 -1.9104189821182802 treat image : temp/1762818027_3549798_1393763120_b4f8decccb46946cec7adef98a08d87f.jpg resize: (1080, 1920) 1393763120 -0.8982133665242873 treat image : temp/1762818027_3549798_1393763085_35ef64d157ad9bee5bde5c2fa0293916.jpg resize: (1080, 1920) 1393763085 -1.9360460139004612 treat image : temp/1762818027_3549798_1393763044_a56bc3191d449cbcaf74226f3d6a4bdb.jpg resize: (1080, 1920) 1393763044 -1.4086161122415515 treat image : temp/1762818027_3549798_1393763015_d20d4a7d543bb8d70b55b55d8223e39b.jpg resize: (1080, 1920) 1393763015 -0.7313261251413169 treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea.jpg resize: (1080, 1920) 1393763001 -1.079132169851866 treat image : temp/1762818027_3549798_1393763284_2e4ff3689ac60d81b7f09953fce42836_rle_crop_4030116411_0.png resize: (54, 95) 1393842637 1.2640911390215126 treat image : temp/1762818027_3549798_1393763282_c7ccc1cfa376884ae66238fd22313d56_rle_crop_4030116413_0.png resize: (88, 133) 1393842638 2.6405115681693867 treat image : temp/1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116416_0.png resize: (84, 65) 1393842639 -0.005882662043852736 treat image : temp/1762818027_3549798_1393763211_ff95b90a6ff6dbb25ec4b6acd4ca11c1_rle_crop_4030116419_0.png resize: (86, 136) 1393842640 0.7255253400675402 treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116422_0.png resize: (125, 42) 1393842641 -0.7807245589914165 treat image : temp/1762818027_3549798_1393763192_30ee11a0669e32e08b1dca807ace7f83_rle_crop_4030116429_0.png resize: (119, 62) 1393842642 1.467079826882116 treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116434_0.png resize: (98, 136) 1393842643 -1.1386996138660828 treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116444_0.png resize: (128, 80) 1393842644 0.26513502915303017 treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116443_0.png resize: (90, 108) 1393842645 -2.0013804924966205 treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116445_0.png resize: (180, 134) 1393842646 -2.3522378889158326 treat image : temp/1762818027_3549798_1393763286_6a0f6a6bced83a7dd2840bd7cd9dc9d4_rle_crop_4030116409_0.png resize: (121, 149) 1393842648 -0.5071623490146586 treat image : temp/1762818027_3549798_1393763282_c7ccc1cfa376884ae66238fd22313d56_rle_crop_4030116412_0.png resize: (108, 180) 1393842649 -2.1063700400794625 treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116420_0.png resize: (90, 141) 1393842650 0.43269769467217695 treat image : temp/1762818027_3549798_1393763205_db5349d35d738c8651a3d802ae235e4b_rle_crop_4030116427_0.png resize: (143, 103) 1393842651 -0.29574303445019046 treat image : temp/1762818027_3549798_1393763192_30ee11a0669e32e08b1dca807ace7f83_rle_crop_4030116428_0.png resize: (94, 166) 1393842652 -0.23967798039347477 treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116435_0.png resize: (148, 155) 1393842653 -1.7552275275799334 treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116441_0.png resize: (93, 142) 1393842654 0.2938162589418691 treat image : temp/1762818027_3549798_1393763286_6a0f6a6bced83a7dd2840bd7cd9dc9d4_rle_crop_4030116410_0.png resize: (93, 118) 1393842658 -2.341423352703966 treat image : temp/1762818027_3549798_1393763279_5d84b1b96ac6d5ff02e129b084195772_rle_crop_4030116415_0.png resize: (983, 964) 1393842659 -0.05883215713751646 treat image : temp/1762818027_3549798_1393763279_5d84b1b96ac6d5ff02e129b084195772_rle_crop_4030116414_0.png resize: (236, 146) 1393842660 -1.60325549233929 treat image : temp/1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116418_0.png resize: (98, 130) 1393842661 -3.1575325888436603 treat image : temp/1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116417_0.png resize: (528, 329) 1393842662 0.3330839178783353 treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116423_0.png resize: (60, 70) 1393842663 -3.1612486693776423 treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116425_0.png resize: (133, 113) 1393842664 -2.757785554620448 treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116426_0.png resize: (154, 123) 1393842665 0.12974657989426922 treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116424_0.png resize: (141, 159) 1393842666 -1.3451925136685496 treat image : temp/1762818027_3549798_1393763191_9bb2822e564c362859d9b600dfc52d1b_rle_crop_4030116430_0.png resize: (462, 327) 1393842667 -0.6680685861587322 treat image : temp/1762818027_3549798_1393763188_8c1a1ed0bf4d2704b12deb171acc00bf_rle_crop_4030116431_0.png resize: (252, 163) 1393842668 -1.75741914660115 treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116432_0.png resize: (173, 102) 1393842669 -0.9279004594495933 treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116433_0.png resize: (106, 186) 1393842670 -3.7603774040580107 treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116436_0.png resize: (527, 334) 1393842671 -0.41231874589931544 treat image : temp/1762818027_3549798_1393763085_35ef64d157ad9bee5bde5c2fa0293916_rle_crop_4030116438_0.png resize: (149, 89) 1393842672 -1.493409401751268 treat image : temp/1762818027_3549798_1393763085_35ef64d157ad9bee5bde5c2fa0293916_rle_crop_4030116437_0.png resize: (120, 169) 1393842673 -3.2303165392772537 treat image : temp/1762818027_3549798_1393763044_a56bc3191d449cbcaf74226f3d6a4bdb_rle_crop_4030116439_0.png resize: (206, 185) 1393842674 -1.5896610846902055 treat image : temp/1762818027_3549798_1393763044_a56bc3191d449cbcaf74226f3d6a4bdb_rle_crop_4030116440_0.png resize: (504, 328) 1393842675 -0.5679695890271006 treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116442_0.png resize: (140, 105) 1393842676 -3.9832326057278595 treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116421_0.png resize: (79, 88) 1393842678 -0.5231331905631879 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 54 time used for this insertion : 0.014896631240844727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 54 time used for this insertion : 0.015407323837280273 save missing photos in datou_result : time spend for datou_step_exec : 14.25916600227356 time spend to save output : 0.03478360176086426 total time spend for step 6 : 14.293949604034424 step7:brightness Tue Nov 11 00:41:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1762818027_3549798_1393763286_6a0f6a6bced83a7dd2840bd7cd9dc9d4.jpg treat image : temp/1762818027_3549798_1393763284_2e4ff3689ac60d81b7f09953fce42836.jpg treat image : temp/1762818027_3549798_1393763282_c7ccc1cfa376884ae66238fd22313d56.jpg treat image : temp/1762818027_3549798_1393763279_5d84b1b96ac6d5ff02e129b084195772.jpg treat image : temp/1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1.jpg treat image : temp/1762818027_3549798_1393763211_ff95b90a6ff6dbb25ec4b6acd4ca11c1.jpg treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6.jpg treat image : temp/1762818027_3549798_1393763205_db5349d35d738c8651a3d802ae235e4b.jpg treat image : temp/1762818027_3549798_1393763192_30ee11a0669e32e08b1dca807ace7f83.jpg treat image : temp/1762818027_3549798_1393763191_9bb2822e564c362859d9b600dfc52d1b.jpg treat image : temp/1762818027_3549798_1393763188_8c1a1ed0bf4d2704b12deb171acc00bf.jpg treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a.jpg treat image : temp/1762818027_3549798_1393763120_b4f8decccb46946cec7adef98a08d87f.jpg treat image : temp/1762818027_3549798_1393763085_35ef64d157ad9bee5bde5c2fa0293916.jpg treat image : temp/1762818027_3549798_1393763044_a56bc3191d449cbcaf74226f3d6a4bdb.jpg treat image : temp/1762818027_3549798_1393763015_d20d4a7d543bb8d70b55b55d8223e39b.jpg treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea.jpg treat image : temp/1762818027_3549798_1393763284_2e4ff3689ac60d81b7f09953fce42836_rle_crop_4030116411_0.png treat image : temp/1762818027_3549798_1393763282_c7ccc1cfa376884ae66238fd22313d56_rle_crop_4030116413_0.png treat image : temp/1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116416_0.png treat image : temp/1762818027_3549798_1393763211_ff95b90a6ff6dbb25ec4b6acd4ca11c1_rle_crop_4030116419_0.png treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116422_0.png treat image : temp/1762818027_3549798_1393763192_30ee11a0669e32e08b1dca807ace7f83_rle_crop_4030116429_0.png treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116434_0.png treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116444_0.png treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116443_0.png treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116445_0.png treat image : temp/1762818027_3549798_1393763286_6a0f6a6bced83a7dd2840bd7cd9dc9d4_rle_crop_4030116409_0.png treat image : temp/1762818027_3549798_1393763282_c7ccc1cfa376884ae66238fd22313d56_rle_crop_4030116412_0.png treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116420_0.png treat image : temp/1762818027_3549798_1393763205_db5349d35d738c8651a3d802ae235e4b_rle_crop_4030116427_0.png treat image : temp/1762818027_3549798_1393763192_30ee11a0669e32e08b1dca807ace7f83_rle_crop_4030116428_0.png treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116435_0.png treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116441_0.png treat image : temp/1762818027_3549798_1393763286_6a0f6a6bced83a7dd2840bd7cd9dc9d4_rle_crop_4030116410_0.png treat image : temp/1762818027_3549798_1393763279_5d84b1b96ac6d5ff02e129b084195772_rle_crop_4030116415_0.png treat image : temp/1762818027_3549798_1393763279_5d84b1b96ac6d5ff02e129b084195772_rle_crop_4030116414_0.png treat image : temp/1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116418_0.png treat image : temp/1762818027_3549798_1393763276_370b62976711ff01c5994f24aa5881b1_rle_crop_4030116417_0.png treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116423_0.png treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116425_0.png treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116426_0.png treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116424_0.png treat image : temp/1762818027_3549798_1393763191_9bb2822e564c362859d9b600dfc52d1b_rle_crop_4030116430_0.png treat image : temp/1762818027_3549798_1393763188_8c1a1ed0bf4d2704b12deb171acc00bf_rle_crop_4030116431_0.png treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116432_0.png treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116433_0.png treat image : temp/1762818027_3549798_1393763152_468e232be56fbd182dbbb3a081b9238a_rle_crop_4030116436_0.png treat image : temp/1762818027_3549798_1393763085_35ef64d157ad9bee5bde5c2fa0293916_rle_crop_4030116438_0.png treat image : temp/1762818027_3549798_1393763085_35ef64d157ad9bee5bde5c2fa0293916_rle_crop_4030116437_0.png treat image : temp/1762818027_3549798_1393763044_a56bc3191d449cbcaf74226f3d6a4bdb_rle_crop_4030116439_0.png treat image : temp/1762818027_3549798_1393763044_a56bc3191d449cbcaf74226f3d6a4bdb_rle_crop_4030116440_0.png treat image : temp/1762818027_3549798_1393763001_1c9dd61118dd3bda6d8b8562ce7eedea_rle_crop_4030116442_0.png treat image : temp/1762818027_3549798_1393763210_70af57e546039a371c8a5c323f919ef6_rle_crop_4030116421_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 54 time used for this insertion : 0.015950918197631836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 54 time used for this insertion : 0.016019582748413086 save missing photos in datou_result : time spend for datou_step_exec : 3.9000651836395264 time spend to save output : 0.0368962287902832 total time spend for step 7 : 3.9369614124298096 step8:velours_tree Tue Nov 11 00:41:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1348724365234375 time spend to save output : 4.4345855712890625e-05 total time spend for step 8 : 0.1349167823791504 step9:send_mail_cod Tue Nov 11 00:41:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28415993_11-11-2025_00_41_42.pdf 28416311 imagette284163111762818102 28416312 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284163121762818102 28416313 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284163131762818103 28416315 change filename to text .imagette284163151762818103 28416316 imagette284163161762818103 28416317 imagette284163171762818103 28416318 imagette284163181762818103 28416319 imagette284163191762818103 28416320 imagette284163201762818103 28416321 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284163211762818103 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28415993 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28416311,28416312,28416313,28416314,28416315,28416316,28416317,28416318,28416319,28416320,28416321?tags=mal_croppe,papier,carton,environnement,autre,pehd,pet_fonce,flou,background,metal,pet_clair args[1393763286] : ((1393763286, -1.6699448830544663, 492688767), (1393763286, 0.5464833064145076, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763284] : ((1393763284, -1.5744119953370426, 492688767), (1393763284, 0.7307592802096392, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763282] : ((1393763282, -1.8698849932897885, 492688767), (1393763282, 0.41480993991310144, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763279] : ((1393763279, -1.4026513870689923, 492688767), (1393763279, 0.5344214056782953, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763276] : ((1393763276, -2.135093270809224, 492609224), (1393763276, 0.44353339603786546, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763211] : ((1393763211, -1.4470460223850807, 492688767), (1393763211, 0.393150435011416, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763210] : ((1393763210, -2.485645888129919, 492609224), (1393763210, 0.5389422949491544, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763205] : ((1393763205, -1.2924484258642186, 492688767), (1393763205, 0.4501264541343933, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763192] : ((1393763192, -1.1072950906124046, 492688767), (1393763192, 0.46915750370105186, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763191] : ((1393763191, -0.7253322465411395, 492688767), (1393763191, 0.5260591720415813, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763188] : ((1393763188, -1.1673600933577588, 492688767), (1393763188, 0.4705188734026118, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763152] : ((1393763152, -1.9104189821182802, 492688767), (1393763152, 0.4650636431205353, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763120] : ((1393763120, -0.8982133665242873, 492688767), (1393763120, 0.4551626224167627, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763085] : ((1393763085, -1.9360460139004612, 492688767), (1393763085, 0.42703267118179994, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763044] : ((1393763044, -1.4086161122415515, 492688767), (1393763044, 0.46391038375168736, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763015] : ((1393763015, -0.7313261251413169, 492688767), (1393763015, 0.6218487660809286, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com args[1393763001] : ((1393763001, -1.079132169851866, 492688767), (1393763001, 0.6541526890505165, 2107752395), '0.04186926969862018') We are sending mail with results at report@fotonower.com refus_total : 0.04186926969862018 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28415993 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28415993_11-11-2025_00_41_42.pdf results_Auto_P28415993_11-11-2025_00_41_42.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28415993_11-11-2025_00_41_42.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28415993','results_Auto_P28415993_11-11-2025_00_41_42.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28415993_11-11-2025_00_41_42.pdf','pdf','','0.29','0.04186926969862018') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28415993

https://www.fotonower.com/image?json=false&list_photos_id=1393763286
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763284
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763282
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763279
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763276
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763211
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763210
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763205
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763192
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763191
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763188
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763152
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763120
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763085
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763044
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763015
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393763001
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.19%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28416312?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28416313?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28416315?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28416321?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28415993_11-11-2025_00_41_42.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28416311,28416312,28416313,28416314,28416315,28416316,28416317,28416318,28416319,28416320,28416321?tags=mal_croppe,papier,carton,environnement,autre,pehd,pet_fonce,flou,background,metal,pet_clair.


L'équipe Fotonower 202 b'' Date: Mon, 10 Nov 2025 23:41:47 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: NAPsxAIYT8GstkPYe5bLhA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1393763286, 1393763284, 1393763282, 1393763279, 1393763276, 1393763211, 1393763210, 1393763205, 1393763192, 1393763191, 1393763188, 1393763152, 1393763120, 1393763085, 1393763044, 1393763015, 1393763001] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763286', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763284', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763282', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763279', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763276', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763211', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763210', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763205', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763192', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763191', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763188', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763152', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763120', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763085', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763044', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763015', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763001', None, None, None, None, None, '4030164') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.01835942268371582 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.167858600616455 time spend to save output : 0.0186460018157959 total time spend for step 9 : 5.186504602432251 step10:split_time_score Tue Nov 11 00:41:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 17),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10112025 28415993 Nombre de photos uploadées : 17 / 23040 (0%) 10112025 28415993 Nombre de photos taguées (types de déchets): 0 / 17 (0%) 10112025 28415993 Nombre de photos taguées (volume) : 0 / 17 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008208751678466797 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20564627647399902 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05438819526530078 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28395537_10-11-2025_16_11_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28395537 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28395537 AND mptpi.`type`=3594 To do Qualite : 0.10644557554713807 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28381336_10-11-2025_09_32_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28381336 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28381336 AND mptpi.`type`=3594 To do Qualite : 0.552663215877915 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28388418_10-11-2025_12_42_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28388418 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28388418 AND mptpi.`type`=3594 To do Qualite : 0.09754239004629629 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28388428_10-11-2025_12_31_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28388428 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28388428 AND mptpi.`type`=3594 To do Qualite : 0.017608453360768175 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28395540_10-11-2025_15_51_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28395540 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28395540 AND mptpi.`type`=3594 To do Qualite : 0.04186926969862018 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28415993_11-11-2025_00_41_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28415993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28415993 AND mptpi.`type`=3594 To do Qualite : 0.026368935667438267 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28403692_10-11-2025_19_01_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28403692 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28403692 AND mptpi.`type`=3594 To do Qualite : 0.08892679398148148 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28406458_10-11-2025_20_21_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28406458 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28406458 AND mptpi.`type`=3594 To do Qualite : 0.24197368103780867 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28406460_10-11-2025_20_11_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28406460 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28406460 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10112025': {'nb_upload': 17, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1393763286, 1393763284, 1393763282, 1393763279, 1393763276, 1393763211, 1393763210, 1393763205, 1393763192, 1393763191, 1393763188, 1393763152, 1393763120, 1393763085, 1393763044, 1393763015, 1393763001] Looping around the photos to save general results len do output : 1 /28415993Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763286', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763284', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763282', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763279', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763276', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763211', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763210', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763205', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763192', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763191', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763188', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763152', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763120', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763085', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763044', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763015', None, None, None, None, None, '4030164') ('3318', None, None, None, None, None, None, None, '4030164') ('3318', '28415993', '1393763001', None, None, None, None, None, '4030164') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.015857696533203125 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8971462249755859 time spend to save output : 0.0161135196685791 total time spend for step 10 : 0.913259744644165 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 17 set_done_treatment 46.23user 21.47system 1:23.75elapsed 80%CPU (0avgtext+0avgdata 2799904maxresident)k 1209560inputs+19392outputs (4536major+1720290minor)pagefaults 0swaps